Apr 19 07:53:23 user devstack@n-api.service[61207]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 19 07:53:23 user devstack@n-api.service[61207]: *** Starting uWSGI 2.0.20-debian (64bit) on [Wed Apr 19 07:53:23 2023] *** Apr 19 07:53:23 user devstack@n-api.service[61207]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 19 07:53:23 user devstack@n-api.service[61207]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 19 07:53:23 user devstack@n-api.service[61207]: nodename: user Apr 19 07:53:23 user devstack@n-api.service[61207]: machine: x86_64 Apr 19 07:53:23 user devstack@n-api.service[61207]: clock source: unix Apr 19 07:53:23 user devstack@n-api.service[61207]: pcre jit disabled Apr 19 07:53:23 user devstack@n-api.service[61207]: detected number of CPU cores: 12 Apr 19 07:53:23 user devstack@n-api.service[61207]: current working directory: / Apr 19 07:53:23 user devstack@n-api.service[61207]: detected binary path: /usr/bin/uwsgi-core Apr 19 07:53:23 user devstack@n-api.service[61207]: your processes number limit is 63637 Apr 19 07:53:23 user devstack@n-api.service[61207]: your memory page size is 4096 bytes Apr 19 07:53:23 user devstack@n-api.service[61207]: detected max file descriptor number: 2048 Apr 19 07:53:23 user devstack@n-api.service[61207]: lock engine: pthread robust mutexes Apr 19 07:53:23 user devstack@n-api.service[61207]: thunder lock: enabled Apr 19 07:53:23 user devstack@n-api.service[61207]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 19 07:53:23 user devstack@n-api.service[61207]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 19 07:53:23 user devstack@n-api.service[61207]: Python main interpreter initialized at 0x55f8b267b990 Apr 19 07:53:23 user devstack@n-api.service[61207]: python threads support enabled Apr 19 07:53:23 user devstack@n-api.service[61207]: your server socket listen backlog is limited to 100 connections Apr 19 07:53:23 user devstack@n-api.service[61207]: your mercy for graceful operations on workers is 90 seconds Apr 19 07:53:23 user devstack@n-api.service[61207]: mapped 537436 bytes (524 KB) for 3 cores Apr 19 07:53:23 user devstack@n-api.service[61207]: *** Operational MODE: preforking *** Apr 19 07:53:23 user devstack@n-api.service[61207]: *** uWSGI is running in multiple interpreter mode *** Apr 19 07:53:23 user devstack@n-api.service[61207]: spawned uWSGI master process (pid: 61207) Apr 19 07:53:23 user devstack@n-api.service[61207]: spawned uWSGI worker 1 (pid: 61208, cores: 1) Apr 19 07:53:23 user devstack@n-api.service[61207]: spawned uWSGI worker 2 (pid: 61209, cores: 1) Apr 19 07:53:23 user devstack@n-api.service[61207]: spawned uWSGI worker 3 (pid: 61210, cores: 1) Apr 19 07:53:23 user devstack@n-api.service[61207]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 19 07:53:24 user devstack@n-api.service[61209]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 19 07:53:24 user devstack@n-api.service[61210]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 19 07:53:24 user devstack@n-api.service[61208]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 19 07:53:27 user devstack@n-api.service[61209]: live_migration_uri is deprecated for removal in favor of two other options that Apr 19 07:53:27 user devstack@n-api.service[61209]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 19 07:53:27 user devstack@n-api.service[61209]: and ``live_migration_inbound_addr`` respectively. Apr 19 07:53:27 user devstack@n-api.service[61209]: ). Its value may be silently ignored in the future. Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 19 07:53:27 user devstack@n-api.service[61210]: live_migration_uri is deprecated for removal in favor of two other options that Apr 19 07:53:27 user devstack@n-api.service[61210]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 19 07:53:27 user devstack@n-api.service[61210]: and ``live_migration_inbound_addr`` respectively. Apr 19 07:53:27 user devstack@n-api.service[61210]: ). Its value may be silently ignored in the future. Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 19 07:53:27 user devstack@n-api.service[61208]: live_migration_uri is deprecated for removal in favor of two other options that Apr 19 07:53:27 user devstack@n-api.service[61208]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 19 07:53:27 user devstack@n-api.service[61208]: and ``live_migration_inbound_addr`` respectively. Apr 19 07:53:27 user devstack@n-api.service[61208]: ). Its value may be silently ignored in the future. Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61209) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61210) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61208) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 19 07:53:27 user devstack@n-api.service[61209]: INFO dbcounter [None req-19f26f6d-8081-4f44-8995-afac710d59fb None None] Registered counter for database nova_api Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG oslo_db.sqlalchemy.engines [None req-19f26f6d-8081-4f44-8995-afac710d59fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61209) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 07:53:27 user devstack@n-api.service[61210]: INFO dbcounter [None req-a3fd2440-67e0-41f1-bbfe-1872de8ab0d6 None None] Registered counter for database nova_api Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writer thread running {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 07:53:27 user devstack@n-api.service[61208]: INFO dbcounter [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] Registered counter for database nova_api Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG oslo_db.sqlalchemy.engines [None req-a3fd2440-67e0-41f1-bbfe-1872de8ab0d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61210) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writer thread running {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG oslo_db.sqlalchemy.engines [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61208) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writer thread running {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG nova.context [None req-19f26f6d-8081-4f44-8995-afac710d59fb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10(cell1) {{(pid=61209) load_cells /opt/stack/nova/nova/context.py:464}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-19f26f6d-8081-4f44-8995-afac710d59fb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-19f26f6d-8081-4f44-8995-afac710d59fb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-19f26f6d-8081-4f44-8995-afac710d59fb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-19f26f6d-8081-4f44-8995-afac710d59fb None None] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-19f26f6d-8081-4f44-8995-afac710d59fb None None] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-19f26f6d-8081-4f44-8995-afac710d59fb None None] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:53:27 user devstack@n-api.service[61209]: INFO dbcounter [None req-19f26f6d-8081-4f44-8995-afac710d59fb None None] Registered counter for database nova_cell0 Apr 19 07:53:27 user devstack@n-api.service[61209]: INFO dbcounter [None req-19f26f6d-8081-4f44-8995-afac710d59fb None None] Registered counter for database nova_cell1 Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG oslo_db.sqlalchemy.engines [None req-19f26f6d-8081-4f44-8995-afac710d59fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61209) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG oslo_db.sqlalchemy.engines [None req-19f26f6d-8081-4f44-8995-afac710d59fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61209) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writer thread running {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG nova.context [None req-a3fd2440-67e0-41f1-bbfe-1872de8ab0d6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10(cell1) {{(pid=61210) load_cells /opt/stack/nova/nova/context.py:464}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a3fd2440-67e0-41f1-bbfe-1872de8ab0d6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a3fd2440-67e0-41f1-bbfe-1872de8ab0d6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a3fd2440-67e0-41f1-bbfe-1872de8ab0d6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a3fd2440-67e0-41f1-bbfe-1872de8ab0d6 None None] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a3fd2440-67e0-41f1-bbfe-1872de8ab0d6 None None] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a3fd2440-67e0-41f1-bbfe-1872de8ab0d6 None None] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:53:27 user devstack@n-api.service[61210]: INFO dbcounter [None req-a3fd2440-67e0-41f1-bbfe-1872de8ab0d6 None None] Registered counter for database nova_cell0 Apr 19 07:53:27 user devstack@n-api.service[61210]: INFO dbcounter [None req-a3fd2440-67e0-41f1-bbfe-1872de8ab0d6 None None] Registered counter for database nova_cell1 Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG nova.context [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10(cell1) {{(pid=61208) load_cells /opt/stack/nova/nova/context.py:464}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG oslo_db.sqlalchemy.engines [None req-a3fd2440-67e0-41f1-bbfe-1872de8ab0d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61210) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 07:53:27 user devstack@n-api.service[61208]: INFO dbcounter [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] Registered counter for database nova_cell0 Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writer thread running {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG oslo_db.sqlalchemy.engines [None req-a3fd2440-67e0-41f1-bbfe-1872de8ab0d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61210) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 07:53:27 user devstack@n-api.service[61208]: INFO dbcounter [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] Registered counter for database nova_cell1 Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG oslo_db.sqlalchemy.engines [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61208) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writer thread running {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG oslo_db.sqlalchemy.engines [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61208) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writer thread running {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 07:53:27 user devstack@n-api.service[61209]: INFO dbcounter [None req-19f26f6d-8081-4f44-8995-afac710d59fb None None] Registered counter for database nova_cell0 Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG oslo_db.sqlalchemy.engines [None req-19f26f6d-8081-4f44-8995-afac710d59fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61209) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 07:53:27 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writer thread running {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writer thread running {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 07:53:27 user devstack@n-api.service[61210]: INFO dbcounter [None req-a3fd2440-67e0-41f1-bbfe-1872de8ab0d6 None None] Registered counter for database nova_cell0 Apr 19 07:53:27 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writer thread running {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG oslo_db.sqlalchemy.engines [None req-a3fd2440-67e0-41f1-bbfe-1872de8ab0d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61210) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 07:53:27 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writer thread running {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 07:53:28 user devstack@n-api.service[61208]: INFO dbcounter [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] Registered counter for database nova_cell0 Apr 19 07:53:28 user devstack@n-api.service[61208]: DEBUG oslo_db.sqlalchemy.engines [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61208) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 19 07:53:28 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writer thread running {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 19 07:53:28 user devstack@n-api.service[61209]: WARNING keystonemiddleware.auth_token [None req-19f26f6d-8081-4f44-8995-afac710d59fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 07:53:28 user devstack@n-api.service[61209]: WARNING keystonemiddleware.auth_token [None req-19f26f6d-8081-4f44-8995-afac710d59fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 07:53:28 user devstack@n-api.service[61210]: WARNING keystonemiddleware.auth_token [None req-a3fd2440-67e0-41f1-bbfe-1872de8ab0d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 07:53:28 user devstack@n-api.service[61210]: WARNING keystonemiddleware.auth_token [None req-a3fd2440-67e0-41f1-bbfe-1872de8ab0d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 07:53:28 user devstack@n-api.service[61208]: WARNING keystonemiddleware.auth_token [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 07:53:28 user devstack@n-api.service[61208]: WARNING keystonemiddleware.auth_token [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 07:53:28 user devstack@n-api.service[61209]: WARNING keystonemiddleware.auth_token [None req-19f26f6d-8081-4f44-8995-afac710d59fb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 07:53:28 user devstack@n-api.service[61209]: WARNING keystonemiddleware.auth_token [None req-19f26f6d-8081-4f44-8995-afac710d59fb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 07:53:28 user devstack@n-api.service[61209]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f8b267b990 pid: 61209 (default app) Apr 19 07:53:28 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-19f26f6d-8081-4f44-8995-afac710d59fb None None] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:53:28 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-19f26f6d-8081-4f44-8995-afac710d59fb None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001506 Apr 19 07:53:28 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Wed Apr 19 07:53:28 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 07:53:28 user devstack@n-api.service[61210]: WARNING keystonemiddleware.auth_token [None req-a3fd2440-67e0-41f1-bbfe-1872de8ab0d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 07:53:28 user devstack@n-api.service[61210]: WARNING keystonemiddleware.auth_token [None req-a3fd2440-67e0-41f1-bbfe-1872de8ab0d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 07:53:28 user devstack@n-api.service[61210]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f8b267b990 pid: 61210 (default app) Apr 19 07:53:28 user devstack@n-api.service[61208]: WARNING keystonemiddleware.auth_token [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 19 07:53:28 user devstack@n-api.service[61208]: WARNING keystonemiddleware.auth_token [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 19 07:53:28 user devstack@n-api.service[61208]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f8b267b990 pid: 61208 (default app) Apr 19 07:55:36 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-19f26f6d-8081-4f44-8995-afac710d59fb None None] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:55:36 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-19f26f6d-8081-4f44-8995-afac710d59fb None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001488 Apr 19 07:55:36 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 07:55:36 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 07:55:36 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=3 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 07:55:36 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=3 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 07:55:36 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell0:SELECT=3 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 07:55:36 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell0:SELECT=3 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 07:55:36 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-3819e951-8f73-4cef-a05b-0e1700bee6d2 admin admin] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:55:36 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-3819e951-8f73-4cef-a05b-0e1700bee6d2 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.370804 Apr 19 07:55:36 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 19 07:55:36 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 07:55:38 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:55:38 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.005286 Apr 19 07:55:38 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 07:55:38 2023] GET /compute/v2.1 => generated 387 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 07:55:38 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=3 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 07:55:38 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=3 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 07:55:38 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=3 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 07:55:38 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 07:55:39 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-5d6e43ea-273b-4b44-9ecb-cabbeaad57e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "id": "c1", "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 256, "swap": 0}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:55:39 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-5d6e43ea-273b-4b44-9ecb-cabbeaad57e7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.336325 Apr 19 07:55:39 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 07:55:38 2023] POST /compute/v2.1/flavors => generated 405 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 07:55:39 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-efcf9890-877e-467a-bb24-851000fa5643 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:55:39 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-efcf9890-877e-467a-bb24-851000fa5643 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046091 Apr 19 07:55:39 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 07:55:39 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 07:55:41 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:55:41 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001937 Apr 19 07:55:41 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 07:55:41 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 07:55:41 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-adcb016f-86be-4fbf-b455-8cea9fa7e1e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5, "swap": 0, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:55:41 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-adcb016f-86be-4fbf-b455-8cea9fa7e1e2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.068907 Apr 19 07:55:41 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 07:55:41 2023] POST /compute/v2.1/flavors => generated 402 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 07:55:41 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-c924980b-4001-4776-8e82-a361d1cc5004 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:55:41 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-c924980b-4001-4776-8e82-a361d1cc5004 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030767 Apr 19 07:55:41 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 07:55:41 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 07:55:43 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:55:43 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001338 Apr 19 07:55:43 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 07:55:43 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 07:55:43 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-9c8d8026-f9bb-4390-a8ea-9c0520358f4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "vcpus": 1, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:55:43 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-9c8d8026-f9bb-4390-a8ea-9c0520358f4a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.061638 Apr 19 07:55:43 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 07:55:43 2023] POST /compute/v2.1/flavors => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 07:55:43 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-150ed181-7d47-491a-b32c-3d9762f1ab63 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:55:43 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-150ed181-7d47-491a-b32c-3d9762f1ab63 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035906 Apr 19 07:55:43 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 07:55:43 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 07:55:45 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:55:45 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001378 Apr 19 07:55:45 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 07:55:45 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 07:55:45 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-81773a52-7924-4a37-b14f-2267f569349d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:55:45 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-81773a52-7924-4a37-b14f-2267f569349d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072629 Apr 19 07:55:45 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 07:55:45 2023] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 07:55:45 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-1753b4cb-f6a3-4dbe-9d24-36ee2c4269ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:55:45 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-1753b4cb-f6a3-4dbe-9d24-36ee2c4269ad admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026027 Apr 19 07:55:45 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 07:55:45 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 07:55:47 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:55:47 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001327 Apr 19 07:55:47 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 07:55:47 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 07:55:47 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-faee3c86-1c84-489d-b3de-d7219c1898ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "disk": 20, "id": "d4"}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:55:47 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-faee3c86-1c84-489d-b3de-d7219c1898ae admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.062097 Apr 19 07:55:47 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 07:55:47 2023] POST /compute/v2.1/flavors => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 07:55:47 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-ba326cc5-727b-427a-bf35-eac5f6b4e2bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:55:47 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-ba326cc5-727b-427a-bf35-eac5f6b4e2bf admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028496 Apr 19 07:55:47 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 19 07:55:47 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 07:55:49 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:55:49 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-0e85f2dd-f20d-4363-bcf1-efe955efe632 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001320 Apr 19 07:55:49 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 07:55:49 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 07:55:49 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-067c6410-320c-475a-98a6-5f29f6112534 admin admin] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:55:49 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-067c6410-320c-475a-98a6-5f29f6112534 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.067728 Apr 19 07:55:49 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 19 07:55:49 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 07:55:51 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-ba326cc5-727b-427a-bf35-eac5f6b4e2bf admin admin] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:55:51 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-ba326cc5-727b-427a-bf35-eac5f6b4e2bf admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.003166 Apr 19 07:55:51 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 07:55:51 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 07:55:51 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=3 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 07:55:51 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=3 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 07:55:51 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=3 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 07:55:51 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=3 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 07:55:51 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-03851fcf-a203-4ef4-a473-694eea830c64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "1", "ram": 512, "disk": 1}} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:55:51 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-03851fcf-a203-4ef4-a473-694eea830c64 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.348879 Apr 19 07:55:51 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 07:55:51 2023] POST /compute/v2.1/flavors => generated 400 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 19 07:55:51 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-a8ec61e9-fabf-45c1-b818-1e8adb9a6a2a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:55:51 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-a8ec61e9-fabf-45c1-b818-1e8adb9a6a2a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037163 Apr 19 07:55:51 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 07:55:51 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 07:55:53 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-ba326cc5-727b-427a-bf35-eac5f6b4e2bf admin admin] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:55:53 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-ba326cc5-727b-427a-bf35-eac5f6b4e2bf admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001621 Apr 19 07:55:53 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 07:55:53 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 07:55:53 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-fe95782c-a32b-4798-a86d-00bd0036bfce admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "name": "m1.small", "ram": 2048, "swap": 0, "id": "2", "vcpus": 1}} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:55:53 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-fe95782c-a32b-4798-a86d-00bd0036bfce admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.060563 Apr 19 07:55:53 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 07:55:53 2023] POST /compute/v2.1/flavors => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 07:55:53 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-0b9098c8-fadd-45bf-aa00-80d71b23407b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:55:53 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-0b9098c8-fadd-45bf-aa00-80d71b23407b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026140 Apr 19 07:55:53 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 07:55:53 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 07:55:55 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-ba326cc5-727b-427a-bf35-eac5f6b4e2bf admin admin] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:55:55 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-ba326cc5-727b-427a-bf35-eac5f6b4e2bf admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001570 Apr 19 07:55:55 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 07:55:55 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 07:55:55 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-f60ffe40-3a85-4c28-a36f-937da5721f83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "ram": 4096, "vcpus": 2}} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:55:55 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-f60ffe40-3a85-4c28-a36f-937da5721f83 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.066427 Apr 19 07:55:55 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 07:55:55 2023] POST /compute/v2.1/flavors => generated 404 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 07:55:55 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-365e31ef-d34f-4c3a-be83-200162404d72 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:55:55 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-365e31ef-d34f-4c3a-be83-200162404d72 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027882 Apr 19 07:55:55 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 07:55:55 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 07:55:57 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-ba326cc5-727b-427a-bf35-eac5f6b4e2bf admin admin] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:55:57 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-ba326cc5-727b-427a-bf35-eac5f6b4e2bf admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001803 Apr 19 07:55:57 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 07:55:57 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 07:55:57 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-ae111153-6f10-4694-8388-25727cab5bab admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "id": "4", "disk": 80, "name": "m1.large", "vcpus": 4, "swap": 0}} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:55:57 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-ae111153-6f10-4694-8388-25727cab5bab admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.070345 Apr 19 07:55:57 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 07:55:57 2023] POST /compute/v2.1/flavors => generated 403 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 07:55:57 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-f7383e20-e862-4221-bb03-f7fb1cc73579 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:55:57 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-f7383e20-e862-4221-bb03-f7fb1cc73579 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025326 Apr 19 07:55:57 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 07:55:57 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 07:55:59 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-ba326cc5-727b-427a-bf35-eac5f6b4e2bf admin admin] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:55:59 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-ba326cc5-727b-427a-bf35-eac5f6b4e2bf admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001691 Apr 19 07:55:59 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 19 07:55:59 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 07:55:59 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-a303aecb-3274-425d-bf7e-4ec19eda6931 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "os-flavor-access:is_public": true, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 160, "swap": 0, "vcpus": 8, "id": "5"}} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:55:59 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-a303aecb-3274-425d-bf7e-4ec19eda6931 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.063910 Apr 19 07:55:59 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 19 07:55:59 2023] POST /compute/v2.1/flavors => generated 406 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 07:55:59 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-65006c7e-904a-4c5c-884f-72a91e8e21e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:55:59 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-65006c7e-904a-4c5c-884f-72a91e8e21e4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025662 Apr 19 07:55:59 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 19 07:55:59 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 07:56:30 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-ba326cc5-727b-427a-bf35-eac5f6b4e2bf admin admin] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:56:30 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-ba326cc5-727b-427a-bf35-eac5f6b4e2bf admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001671 Apr 19 07:56:30 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 19 07:56:30 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 07:56:30 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 07:56:31 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-11de5273-62d0-48a3-88a5-f40bd0195674 admin admin] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:56:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-11de5273-62d0-48a3-88a5-f40bd0195674 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:56:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-11de5273-62d0-48a3-88a5-f40bd0195674 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:56:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-11de5273-62d0-48a3-88a5-f40bd0195674 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:56:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-11de5273-62d0-48a3-88a5-f40bd0195674 admin admin] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:56:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-11de5273-62d0-48a3-88a5-f40bd0195674 admin admin] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:56:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-11de5273-62d0-48a3-88a5-f40bd0195674 admin admin] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:56:31 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-11de5273-62d0-48a3-88a5-f40bd0195674 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.107893 Apr 19 07:56:31 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Wed Apr 19 07:56:30 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 07:57:02 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-65006c7e-904a-4c5c-884f-72a91e8e21e4 admin admin] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:57:02 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-65006c7e-904a-4c5c-884f-72a91e8e21e4 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001581 Apr 19 07:57:02 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 19 07:57:02 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 07:57:02 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 07:57:02 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-d6346c0c-9025-42e1-9ea1-47a49d087a78 admin admin] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:57:02 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-d6346c0c-9025-42e1-9ea1-47a49d087a78 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.066877 Apr 19 07:57:02 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Wed Apr 19 07:57:02 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 07:57:07 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-11de5273-62d0-48a3-88a5-f40bd0195674 admin admin] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:57:07 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-11de5273-62d0-48a3-88a5-f40bd0195674 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001724 Apr 19 07:57:07 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 19 07:57:07 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 07:57:07 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 07:57:07 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-9cba9c5e-5c1c-4587-b2c7-ba185260b74c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 128, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.nano", "swap": 0, "id": "42"}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:57:07 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-9cba9c5e-5c1c-4587-b2c7-ba185260b74c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.065598 Apr 19 07:57:07 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 19 07:57:07 2023] POST /compute/v2.1/flavors => generated 403 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 07:57:07 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-12d7a57b-19e1-40bc-a53a-9345c8cffb11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:57:07 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-12d7a57b-19e1-40bc-a53a-9345c8cffb11 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024912 Apr 19 07:57:07 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 19 07:57:07 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 07:57:11 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-11de5273-62d0-48a3-88a5-f40bd0195674 admin admin] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:57:11 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-11de5273-62d0-48a3-88a5-f40bd0195674 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.003260 Apr 19 07:57:11 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 19 07:57:11 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 07:57:11 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-369b5814-de8b-4ca7-bfef-1fc544f799c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 192, "disk": 1, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "84", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.micro"}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:57:11 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-369b5814-de8b-4ca7-bfef-1fc544f799c3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087105 Apr 19 07:57:11 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 19 07:57:11 2023] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 07:57:11 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-a9412da8-e4a9-41fc-b73d-c273d71b6974 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:57:11 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-a9412da8-e4a9-41fc-b73d-c273d71b6974 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027404 Apr 19 07:57:11 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 19 07:57:11 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 07:59:22 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 07:59:22 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 07:59:22 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=4 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 07:59:23 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-c4e8dc6f-ab0f-4ea7-93c8-004bb0210f49 tempest-VolumesSnapshotsTestJSON-1055886302 tempest-VolumesSnapshotsTestJSON-1055886302-project-member] Action: 'create', calling method: .version_select at 0x7f2c01d72dd0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1531506318"}} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:59:24 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-c4e8dc6f-ab0f-4ea7-93c8-004bb0210f49 tempest-VolumesSnapshotsTestJSON-1055886302 tempest-VolumesSnapshotsTestJSON-1055886302-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.438718 Apr 19 07:59:24 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1232 bytes} [Wed Apr 19 07:59:22 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 1441 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 19 07:59:24 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 07:59:24 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-9fb81f38-bf78-466e-8a11-60dfe592017c tempest-VolumesSnapshotsTestJSON-1055886302 tempest-VolumesSnapshotsTestJSON-1055886302-project-member] Calling method '.version_select at 0x7f2c01d6d240>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:59:24 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-9fb81f38-bf78-466e-8a11-60dfe592017c tempest-VolumesSnapshotsTestJSON-1055886302 tempest-VolumesSnapshotsTestJSON-1055886302-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c8cabbaa-5b85-466a-94b4-c071a1fb2dd0" status: 200 len: 342 microversion: 2.1 time: 0.320024 Apr 19 07:59:24 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 07:59:24 2023] GET /compute/v2.1/os-volumes/c8cabbaa-5b85-466a-94b4-c071a1fb2dd0 => generated 342 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 07:59:25 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 07:59:25 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-7ce3ca96-7e2a-4c59-b9b4-a8048ad82d35 tempest-VolumesSnapshotsTestJSON-1055886302 tempest-VolumesSnapshotsTestJSON-1055886302-project-member] Calling method '.version_select at 0x7f2c01d56e60>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:59:26 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-7ce3ca96-7e2a-4c59-b9b4-a8048ad82d35 tempest-VolumesSnapshotsTestJSON-1055886302 tempest-VolumesSnapshotsTestJSON-1055886302-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c8cabbaa-5b85-466a-94b4-c071a1fb2dd0" status: 200 len: 342 microversion: 2.1 time: 0.362842 Apr 19 07:59:26 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 07:59:25 2023] GET /compute/v2.1/os-volumes/c8cabbaa-5b85-466a-94b4-c071a1fb2dd0 => generated 342 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 07:59:26 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-be4de185-4938-499b-9911-ca1315c72a1f tempest-VolumesSnapshotsTestJSON-1055886302 tempest-VolumesSnapshotsTestJSON-1055886302-project-member] Calling method '.version_select at 0x7f2c01dfc5e0>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:59:26 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-be4de185-4938-499b-9911-ca1315c72a1f tempest-VolumesSnapshotsTestJSON-1055886302 tempest-VolumesSnapshotsTestJSON-1055886302-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/c8cabbaa-5b85-466a-94b4-c071a1fb2dd0" status: 202 len: 0 microversion: 2.1 time: 0.231019 Apr 19 07:59:26 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 07:59:26 2023] DELETE /compute/v2.1/os-volumes/c8cabbaa-5b85-466a-94b4-c071a1fb2dd0 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 07:59:26 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-9b84a5c6-cfb0-477b-b821-6a11f0763b35 tempest-VolumesSnapshotsTestJSON-1055886302 tempest-VolumesSnapshotsTestJSON-1055886302-project-member] Calling method '.version_select at 0x7f2c01dfb880>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:59:26 user devstack@n-api.service[61209]: INFO nova.api.openstack.wsgi [None req-9b84a5c6-cfb0-477b-b821-6a11f0763b35 tempest-VolumesSnapshotsTestJSON-1055886302 tempest-VolumesSnapshotsTestJSON-1055886302-project-member] HTTP exception thrown: Volume c8cabbaa-5b85-466a-94b4-c071a1fb2dd0 could not be found. Apr 19 07:59:26 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-9b84a5c6-cfb0-477b-b821-6a11f0763b35 tempest-VolumesSnapshotsTestJSON-1055886302 tempest-VolumesSnapshotsTestJSON-1055886302-project-member] Request method failure captured: Apr 19 07:59:26 user devstack@n-api.service[61209]: request: GET /compute/v2.1/os-volumes/c8cabbaa-5b85-466a-94b4-c071a1fb2dd0 HTTP/1.1 Apr 19 07:59:26 user devstack@n-api.service[61209]: Accept: application/json Apr 19 07:59:26 user devstack@n-api.service[61209]: Accept-Encoding: identity Apr 19 07:59:26 user devstack@n-api.service[61209]: Connection: close Apr 19 07:59:26 user devstack@n-api.service[61209]: Content-Length: 0 Apr 19 07:59:26 user devstack@n-api.service[61209]: Content-Type: application/json Apr 19 07:59:26 user devstack@n-api.service[61209]: Host: 10.0.0.210 Apr 19 07:59:26 user devstack@n-api.service[61209]: Openstack-System-Scope: None Apr 19 07:59:26 user devstack@n-api.service[61209]: User-Agent: python-urllib3/1.26.15 Apr 19 07:59:26 user devstack@n-api.service[61209]: X-Auth-Token: gAAAAABkP59a3vAgYVaEJeROEoL-UIDFOoPK14DhW8IpvInXeNfdOfn_XfLdr_SKEDsZlp3PvqXBEtdPgPOdr4areQOsS6Ont3lXBBVKD6BSx8bEj1G3uvPb6ln0UsmfB6JGJ6USWcln0USwOGd68YrQe5YUqPTl8HVqZt2_D_FAbKrr7jhMt94 Apr 19 07:59:26 user devstack@n-api.service[61209]: X-Domain-Id: None Apr 19 07:59:26 user devstack@n-api.service[61209]: X-Domain-Name: None Apr 19 07:59:26 user devstack@n-api.service[61209]: X-Identity-Status: Confirmed Apr 19 07:59:26 user devstack@n-api.service[61209]: X-Is-Admin-Project: True Apr 19 07:59:26 user devstack@n-api.service[61209]: X-Project-Domain-Id: default Apr 19 07:59:26 user devstack@n-api.service[61209]: X-Project-Domain-Name: Default Apr 19 07:59:26 user devstack@n-api.service[61209]: X-Project-Id: 986a0ee9b2fc4a1aad6fa5fea9dae99b Apr 19 07:59:26 user devstack@n-api.service[61209]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1055886302 Apr 19 07:59:26 user devstack@n-api.service[61209]: X-Role: reader,member Apr 19 07:59:26 user devstack@n-api.service[61209]: X-Roles: reader,member Apr 19 07:59:26 user devstack@n-api.service[61209]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/986a0ee9b2fc4a1aad6fa5fea9dae99b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/986a0ee9b2fc4a1aad6fa5fea9dae99b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/986a0ee9b2fc4a1aad6fa5fea9dae99b"}]}] Apr 19 07:59:26 user devstack@n-api.service[61209]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1055886302 Apr 19 07:59:26 user devstack@n-api.service[61209]: X-Tenant-Id: 986a0ee9b2fc4a1aad6fa5fea9dae99b Apr 19 07:59:26 user devstack@n-api.service[61209]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1055886302 Apr 19 07:59:26 user devstack@n-api.service[61209]: X-User: tempest-VolumesSnapshotsTestJSON-1055886302-project-member Apr 19 07:59:26 user devstack@n-api.service[61209]: X-User-Domain-Id: default Apr 19 07:59:26 user devstack@n-api.service[61209]: X-User-Domain-Name: Default Apr 19 07:59:26 user devstack@n-api.service[61209]: X-User-Id: 7477636033fd414585132f2a95f21099 Apr 19 07:59:26 user devstack@n-api.service[61209]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1055886302-project-member Apr 19 07:59:26 user devstack@n-api.service[61209]: method: Apr 19 07:59:26 user devstack@n-api.service[61209]: exception: Volume c8cabbaa-5b85-466a-94b4-c071a1fb2dd0 could not be found. Apr 19 07:59:26 user devstack@n-api.service[61209]: action_args: {'id': 'c8cabbaa-5b85-466a-94b4-c071a1fb2dd0'} Apr 19 07:59:26 user devstack@n-api.service[61209]: {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c8cabbaa-5b85-466a-94b4-c071a1fb2dd0 could not be found. (HTTP 404) (Request-ID: req-b07ff249-7d6f-451c-be60-941305c2a3f7) Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c8cabbaa-5b85-466a-94b4-c071a1fb2dd0 could not be found. Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c8cabbaa-5b85-466a-94b4-c071a1fb2dd0 could not be found. Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c8cabbaa-5b85-466a-94b4-c071a1fb2dd0 could not be found. Apr 19 07:59:26 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 07:59:26 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-9b84a5c6-cfb0-477b-b821-6a11f0763b35 tempest-VolumesSnapshotsTestJSON-1055886302 tempest-VolumesSnapshotsTestJSON-1055886302-project-member] Returning 404 to user: Volume c8cabbaa-5b85-466a-94b4-c071a1fb2dd0 could not be found. {{(pid=61209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 07:59:26 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-9b84a5c6-cfb0-477b-b821-6a11f0763b35 tempest-VolumesSnapshotsTestJSON-1055886302 tempest-VolumesSnapshotsTestJSON-1055886302-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c8cabbaa-5b85-466a-94b4-c071a1fb2dd0" status: 404 len: 109 microversion: 2.1 time: 0.044882 Apr 19 07:59:26 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 07:59:26 2023] GET /compute/v2.1/os-volumes/c8cabbaa-5b85-466a-94b4-c071a1fb2dd0 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 07:59:30 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-01a4100b-36f3-49ce-b902-ad5b1f3506e2 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] Action: 'create', calling method: .version_select at 0x7f2c01df2d40>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1760702848", "metadata": {"Type": "work"}}} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:59:30 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-01a4100b-36f3-49ce-b902-ad5b1f3506e2 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] Request method failure captured: Apr 19 07:59:30 user devstack@n-api.service[61210]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 19 07:59:30 user devstack@n-api.service[61210]: Accept: application/json Apr 19 07:59:30 user devstack@n-api.service[61210]: Accept-Encoding: identity Apr 19 07:59:30 user devstack@n-api.service[61210]: Connection: close Apr 19 07:59:30 user devstack@n-api.service[61210]: Content-Length: 122 Apr 19 07:59:30 user devstack@n-api.service[61210]: Content-Type: application/json Apr 19 07:59:30 user devstack@n-api.service[61210]: Host: 10.0.0.210 Apr 19 07:59:30 user devstack@n-api.service[61210]: Openstack-System-Scope: None Apr 19 07:59:30 user devstack@n-api.service[61210]: User-Agent: python-urllib3/1.26.15 Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Auth-Token: gAAAAABkP59i1tML8vPAJSyn4JqduirQzn-1dGMJMjOUieg-t24MWrQlc-PlJP9ZKWzNKX6q9H-EjtGGUo8fGFVugZJ2NULSp2Sfp7AVhFFviZ6KIT27kX4cB8tPjehNQTlUwrpZOPaJvhHT_59bWJOz22hK6ZKD3g3F8ZSAr07D17UY3H-qzfs Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Domain-Id: None Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Domain-Name: None Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Identity-Status: Confirmed Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Is-Admin-Project: True Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Project-Domain-Id: default Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Project-Domain-Name: Default Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Project-Id: cf0c9b4586544b9ca91aaa2510f54b57 Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Project-Name: tempest-VolumesNegativeTest-9391374 Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Role: reader,member Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Roles: reader,member Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf0c9b4586544b9ca91aaa2510f54b57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf0c9b4586544b9ca91aaa2510f54b57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf0c9b4586544b9ca91aaa2510f54b57"}]}] Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Tenant: tempest-VolumesNegativeTest-9391374 Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Tenant-Id: cf0c9b4586544b9ca91aaa2510f54b57 Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Tenant-Name: tempest-VolumesNegativeTest-9391374 Apr 19 07:59:30 user devstack@n-api.service[61210]: X-User: tempest-VolumesNegativeTest-9391374-project-member Apr 19 07:59:30 user devstack@n-api.service[61210]: X-User-Domain-Id: default Apr 19 07:59:30 user devstack@n-api.service[61210]: X-User-Domain-Name: Default Apr 19 07:59:30 user devstack@n-api.service[61210]: X-User-Id: 79a03e508ae44a6dacc7070cda00616f Apr 19 07:59:30 user devstack@n-api.service[61210]: X-User-Name: tempest-VolumesNegativeTest-9391374-project-member Apr 19 07:59:30 user devstack@n-api.service[61210]: Apr 19 07:59:30 user devstack@n-api.service[61210]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1760702848", "metadata": {"Type": "work"}}} Apr 19 07:59:30 user devstack@n-api.service[61210]: method: Apr 19 07:59:30 user devstack@n-api.service[61210]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 19 07:59:30 user devstack@n-api.service[61210]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1760702848', 'metadata': {'Type': 'work'}}}} Apr 19 07:59:30 user devstack@n-api.service[61210]: {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise error Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi '#$%' Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-01a4100b-36f3-49ce-b902-ad5b1f3506e2 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 07:59:30 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-01a4100b-36f3-49ce-b902-ad5b1f3506e2 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.181434 Apr 19 07:59:30 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 17/51] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 19 07:59:30 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 183 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 19 07:59:30 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-7e9e8797-0fd7-4114-ac46-6445af703aa9 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] Action: 'create', calling method: .version_select at 0x7f2c01dfcc10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1567762126", "metadata": {"Type": "work"}}} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:59:30 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-7e9e8797-0fd7-4114-ac46-6445af703aa9 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] Request method failure captured: Apr 19 07:59:30 user devstack@n-api.service[61208]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 19 07:59:30 user devstack@n-api.service[61208]: Accept: application/json Apr 19 07:59:30 user devstack@n-api.service[61208]: Accept-Encoding: identity Apr 19 07:59:30 user devstack@n-api.service[61208]: Connection: close Apr 19 07:59:30 user devstack@n-api.service[61208]: Content-Length: 120 Apr 19 07:59:30 user devstack@n-api.service[61208]: Content-Type: application/json Apr 19 07:59:30 user devstack@n-api.service[61208]: Host: 10.0.0.210 Apr 19 07:59:30 user devstack@n-api.service[61208]: Openstack-System-Scope: None Apr 19 07:59:30 user devstack@n-api.service[61208]: User-Agent: python-urllib3/1.26.15 Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Auth-Token: gAAAAABkP59i1tML8vPAJSyn4JqduirQzn-1dGMJMjOUieg-t24MWrQlc-PlJP9ZKWzNKX6q9H-EjtGGUo8fGFVugZJ2NULSp2Sfp7AVhFFviZ6KIT27kX4cB8tPjehNQTlUwrpZOPaJvhHT_59bWJOz22hK6ZKD3g3F8ZSAr07D17UY3H-qzfs Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Domain-Id: None Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Domain-Name: None Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Identity-Status: Confirmed Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Is-Admin-Project: True Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Project-Domain-Id: default Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Project-Domain-Name: Default Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Project-Id: cf0c9b4586544b9ca91aaa2510f54b57 Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Project-Name: tempest-VolumesNegativeTest-9391374 Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Role: reader,member Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Roles: reader,member Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf0c9b4586544b9ca91aaa2510f54b57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf0c9b4586544b9ca91aaa2510f54b57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf0c9b4586544b9ca91aaa2510f54b57"}]}] Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Tenant: tempest-VolumesNegativeTest-9391374 Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Tenant-Id: cf0c9b4586544b9ca91aaa2510f54b57 Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Tenant-Name: tempest-VolumesNegativeTest-9391374 Apr 19 07:59:30 user devstack@n-api.service[61208]: X-User: tempest-VolumesNegativeTest-9391374-project-member Apr 19 07:59:30 user devstack@n-api.service[61208]: X-User-Domain-Id: default Apr 19 07:59:30 user devstack@n-api.service[61208]: X-User-Domain-Name: Default Apr 19 07:59:30 user devstack@n-api.service[61208]: X-User-Id: 79a03e508ae44a6dacc7070cda00616f Apr 19 07:59:30 user devstack@n-api.service[61208]: X-User-Name: tempest-VolumesNegativeTest-9391374-project-member Apr 19 07:59:30 user devstack@n-api.service[61208]: Apr 19 07:59:30 user devstack@n-api.service[61208]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1567762126", "metadata": {"Type": "work"}}} Apr 19 07:59:30 user devstack@n-api.service[61208]: method: Apr 19 07:59:30 user devstack@n-api.service[61208]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 19 07:59:30 user devstack@n-api.service[61208]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1567762126', 'metadata': {'Type': 'work'}}}} Apr 19 07:59:30 user devstack@n-api.service[61208]: {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise error Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi '0' Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-7e9e8797-0fd7-4114-ac46-6445af703aa9 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 07:59:30 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-7e9e8797-0fd7-4114-ac46-6445af703aa9 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012205 Apr 19 07:59:30 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 17/52] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 19 07:59:30 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 19 07:59:30 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-d88baa9f-074c-4037-8497-2d4591cdc03c tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] Action: 'create', calling method: .version_select at 0x7f2c01c4cf70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-562976743", "metadata": {"Type": "work"}}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:59:30 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-d88baa9f-074c-4037-8497-2d4591cdc03c tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] Request method failure captured: Apr 19 07:59:30 user devstack@n-api.service[61209]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 19 07:59:30 user devstack@n-api.service[61209]: Accept: application/json Apr 19 07:59:30 user devstack@n-api.service[61209]: Accept-Encoding: identity Apr 19 07:59:30 user devstack@n-api.service[61209]: Connection: close Apr 19 07:59:30 user devstack@n-api.service[61209]: Content-Length: 118 Apr 19 07:59:30 user devstack@n-api.service[61209]: Content-Type: application/json Apr 19 07:59:30 user devstack@n-api.service[61209]: Host: 10.0.0.210 Apr 19 07:59:30 user devstack@n-api.service[61209]: Openstack-System-Scope: None Apr 19 07:59:30 user devstack@n-api.service[61209]: User-Agent: python-urllib3/1.26.15 Apr 19 07:59:30 user devstack@n-api.service[61209]: X-Auth-Token: gAAAAABkP59i1tML8vPAJSyn4JqduirQzn-1dGMJMjOUieg-t24MWrQlc-PlJP9ZKWzNKX6q9H-EjtGGUo8fGFVugZJ2NULSp2Sfp7AVhFFviZ6KIT27kX4cB8tPjehNQTlUwrpZOPaJvhHT_59bWJOz22hK6ZKD3g3F8ZSAr07D17UY3H-qzfs Apr 19 07:59:30 user devstack@n-api.service[61209]: X-Domain-Id: None Apr 19 07:59:30 user devstack@n-api.service[61209]: X-Domain-Name: None Apr 19 07:59:30 user devstack@n-api.service[61209]: X-Identity-Status: Confirmed Apr 19 07:59:30 user devstack@n-api.service[61209]: X-Is-Admin-Project: True Apr 19 07:59:30 user devstack@n-api.service[61209]: X-Project-Domain-Id: default Apr 19 07:59:30 user devstack@n-api.service[61209]: X-Project-Domain-Name: Default Apr 19 07:59:30 user devstack@n-api.service[61209]: X-Project-Id: cf0c9b4586544b9ca91aaa2510f54b57 Apr 19 07:59:30 user devstack@n-api.service[61209]: X-Project-Name: tempest-VolumesNegativeTest-9391374 Apr 19 07:59:30 user devstack@n-api.service[61209]: X-Role: reader,member Apr 19 07:59:30 user devstack@n-api.service[61209]: X-Roles: reader,member Apr 19 07:59:30 user devstack@n-api.service[61209]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf0c9b4586544b9ca91aaa2510f54b57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf0c9b4586544b9ca91aaa2510f54b57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf0c9b4586544b9ca91aaa2510f54b57"}]}] Apr 19 07:59:30 user devstack@n-api.service[61209]: X-Tenant: tempest-VolumesNegativeTest-9391374 Apr 19 07:59:30 user devstack@n-api.service[61209]: X-Tenant-Id: cf0c9b4586544b9ca91aaa2510f54b57 Apr 19 07:59:30 user devstack@n-api.service[61209]: X-Tenant-Name: tempest-VolumesNegativeTest-9391374 Apr 19 07:59:30 user devstack@n-api.service[61209]: X-User: tempest-VolumesNegativeTest-9391374-project-member Apr 19 07:59:30 user devstack@n-api.service[61209]: X-User-Domain-Id: default Apr 19 07:59:30 user devstack@n-api.service[61209]: X-User-Domain-Name: Default Apr 19 07:59:30 user devstack@n-api.service[61209]: X-User-Id: 79a03e508ae44a6dacc7070cda00616f Apr 19 07:59:30 user devstack@n-api.service[61209]: X-User-Name: tempest-VolumesNegativeTest-9391374-project-member Apr 19 07:59:30 user devstack@n-api.service[61209]: Apr 19 07:59:30 user devstack@n-api.service[61209]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-562976743", "metadata": {"Type": "work"}}} Apr 19 07:59:30 user devstack@n-api.service[61209]: method: Apr 19 07:59:30 user devstack@n-api.service[61209]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 19 07:59:30 user devstack@n-api.service[61209]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-562976743', 'metadata': {'Type': 'work'}}}} Apr 19 07:59:30 user devstack@n-api.service[61209]: {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise error Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi '' Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 19 07:59:30 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-d88baa9f-074c-4037-8497-2d4591cdc03c tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 07:59:30 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-d88baa9f-074c-4037-8497-2d4591cdc03c tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013529 Apr 19 07:59:30 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 19/53] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 19 07:59:30 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 19 07:59:30 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-9460bc69-c8e5-4782-a9c9-3011caff4d24 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] Calling method '.version_select at 0x7f2c0278d360>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:59:30 user devstack@n-api.service[61210]: INFO nova.api.openstack.wsgi [None req-9460bc69-c8e5-4782-a9c9-3011caff4d24 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] HTTP exception thrown: Volume tempest-invalid-930068523 could not be found. Apr 19 07:59:30 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-9460bc69-c8e5-4782-a9c9-3011caff4d24 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] Request method failure captured: Apr 19 07:59:30 user devstack@n-api.service[61210]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-930068523 HTTP/1.1 Apr 19 07:59:30 user devstack@n-api.service[61210]: Accept: application/json Apr 19 07:59:30 user devstack@n-api.service[61210]: Accept-Encoding: identity Apr 19 07:59:30 user devstack@n-api.service[61210]: Connection: close Apr 19 07:59:30 user devstack@n-api.service[61210]: Content-Length: 0 Apr 19 07:59:30 user devstack@n-api.service[61210]: Content-Type: application/json Apr 19 07:59:30 user devstack@n-api.service[61210]: Host: 10.0.0.210 Apr 19 07:59:30 user devstack@n-api.service[61210]: Openstack-System-Scope: None Apr 19 07:59:30 user devstack@n-api.service[61210]: User-Agent: python-urllib3/1.26.15 Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Auth-Token: gAAAAABkP59i1tML8vPAJSyn4JqduirQzn-1dGMJMjOUieg-t24MWrQlc-PlJP9ZKWzNKX6q9H-EjtGGUo8fGFVugZJ2NULSp2Sfp7AVhFFviZ6KIT27kX4cB8tPjehNQTlUwrpZOPaJvhHT_59bWJOz22hK6ZKD3g3F8ZSAr07D17UY3H-qzfs Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Domain-Id: None Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Domain-Name: None Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Identity-Status: Confirmed Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Is-Admin-Project: True Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Project-Domain-Id: default Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Project-Domain-Name: Default Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Project-Id: cf0c9b4586544b9ca91aaa2510f54b57 Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Project-Name: tempest-VolumesNegativeTest-9391374 Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Role: reader,member Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Roles: reader,member Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf0c9b4586544b9ca91aaa2510f54b57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf0c9b4586544b9ca91aaa2510f54b57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf0c9b4586544b9ca91aaa2510f54b57"}]}] Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Tenant: tempest-VolumesNegativeTest-9391374 Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Tenant-Id: cf0c9b4586544b9ca91aaa2510f54b57 Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Tenant-Name: tempest-VolumesNegativeTest-9391374 Apr 19 07:59:30 user devstack@n-api.service[61210]: X-User: tempest-VolumesNegativeTest-9391374-project-member Apr 19 07:59:30 user devstack@n-api.service[61210]: X-User-Domain-Id: default Apr 19 07:59:30 user devstack@n-api.service[61210]: X-User-Domain-Name: Default Apr 19 07:59:30 user devstack@n-api.service[61210]: X-User-Id: 79a03e508ae44a6dacc7070cda00616f Apr 19 07:59:30 user devstack@n-api.service[61210]: X-User-Name: tempest-VolumesNegativeTest-9391374-project-member Apr 19 07:59:30 user devstack@n-api.service[61210]: method: Apr 19 07:59:30 user devstack@n-api.service[61210]: exception: Volume tempest-invalid-930068523 could not be found. Apr 19 07:59:30 user devstack@n-api.service[61210]: action_args: {'id': 'tempest-invalid-930068523'} Apr 19 07:59:30 user devstack@n-api.service[61210]: {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-930068523 could not be found. (HTTP 404) (Request-ID: req-c332a7ae-f4cd-4485-939b-f10f635d3695) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-930068523 could not be found. Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-930068523 could not be found. Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-930068523 could not be found. Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-9460bc69-c8e5-4782-a9c9-3011caff4d24 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] Returning 404 to user: Volume tempest-invalid-930068523 could not be found. {{(pid=61210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 07:59:30 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-9460bc69-c8e5-4782-a9c9-3011caff4d24 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-930068523" status: 404 len: 98 microversion: 2.1 time: 0.038676 Apr 19 07:59:30 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 18/54] 10.0.0.210 () {62 vars in 1292 bytes} [Wed Apr 19 07:59:30 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-930068523 => generated 98 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 19 07:59:30 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-1564edfc-1530-463d-b8fa-f8a072f9e563 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010114 Apr 19 07:59:30 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1217 bytes} [Wed Apr 19 07:59:30 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 19 07:59:30 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-37db1a00-9971-41c9-94b9-c34706f7b6a5 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007987 Apr 19 07:59:30 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 20/56] 10.0.0.210 () {62 vars in 1214 bytes} [Wed Apr 19 07:59:30 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 19 07:59:30 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-602dfd70-3ebf-4888-b4e6-bddfa6552e47 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] Calling method '.version_select at 0x7f2c01c29120>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:59:30 user devstack@n-api.service[61210]: INFO nova.api.openstack.wsgi [None req-602dfd70-3ebf-4888-b4e6-bddfa6552e47 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] HTTP exception thrown: Volume 4b8d90c9-086d-4781-823c-63834c229f76 could not be found. Apr 19 07:59:30 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-602dfd70-3ebf-4888-b4e6-bddfa6552e47 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] Request method failure captured: Apr 19 07:59:30 user devstack@n-api.service[61210]: request: DELETE /compute/v2.1/os-volumes/4b8d90c9-086d-4781-823c-63834c229f76 HTTP/1.1 Apr 19 07:59:30 user devstack@n-api.service[61210]: Accept: application/json Apr 19 07:59:30 user devstack@n-api.service[61210]: Accept-Encoding: identity Apr 19 07:59:30 user devstack@n-api.service[61210]: Connection: close Apr 19 07:59:30 user devstack@n-api.service[61210]: Content-Length: 0 Apr 19 07:59:30 user devstack@n-api.service[61210]: Content-Type: application/json Apr 19 07:59:30 user devstack@n-api.service[61210]: Host: 10.0.0.210 Apr 19 07:59:30 user devstack@n-api.service[61210]: Openstack-System-Scope: None Apr 19 07:59:30 user devstack@n-api.service[61210]: User-Agent: python-urllib3/1.26.15 Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Auth-Token: gAAAAABkP59i1tML8vPAJSyn4JqduirQzn-1dGMJMjOUieg-t24MWrQlc-PlJP9ZKWzNKX6q9H-EjtGGUo8fGFVugZJ2NULSp2Sfp7AVhFFviZ6KIT27kX4cB8tPjehNQTlUwrpZOPaJvhHT_59bWJOz22hK6ZKD3g3F8ZSAr07D17UY3H-qzfs Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Domain-Id: None Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Domain-Name: None Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Identity-Status: Confirmed Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Is-Admin-Project: True Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Project-Domain-Id: default Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Project-Domain-Name: Default Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Project-Id: cf0c9b4586544b9ca91aaa2510f54b57 Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Project-Name: tempest-VolumesNegativeTest-9391374 Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Role: reader,member Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Roles: reader,member Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf0c9b4586544b9ca91aaa2510f54b57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf0c9b4586544b9ca91aaa2510f54b57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf0c9b4586544b9ca91aaa2510f54b57"}]}] Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Tenant: tempest-VolumesNegativeTest-9391374 Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Tenant-Id: cf0c9b4586544b9ca91aaa2510f54b57 Apr 19 07:59:30 user devstack@n-api.service[61210]: X-Tenant-Name: tempest-VolumesNegativeTest-9391374 Apr 19 07:59:30 user devstack@n-api.service[61210]: X-User: tempest-VolumesNegativeTest-9391374-project-member Apr 19 07:59:30 user devstack@n-api.service[61210]: X-User-Domain-Id: default Apr 19 07:59:30 user devstack@n-api.service[61210]: X-User-Domain-Name: Default Apr 19 07:59:30 user devstack@n-api.service[61210]: X-User-Id: 79a03e508ae44a6dacc7070cda00616f Apr 19 07:59:30 user devstack@n-api.service[61210]: X-User-Name: tempest-VolumesNegativeTest-9391374-project-member Apr 19 07:59:30 user devstack@n-api.service[61210]: method: Apr 19 07:59:30 user devstack@n-api.service[61210]: exception: Volume 4b8d90c9-086d-4781-823c-63834c229f76 could not be found. Apr 19 07:59:30 user devstack@n-api.service[61210]: action_args: {'id': '4b8d90c9-086d-4781-823c-63834c229f76'} Apr 19 07:59:30 user devstack@n-api.service[61210]: {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4b8d90c9-086d-4781-823c-63834c229f76 could not be found. (HTTP 404) (Request-ID: req-ae17919a-78b3-49d1-8bcf-f847c59dfd2f) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4b8d90c9-086d-4781-823c-63834c229f76 could not be found. Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4b8d90c9-086d-4781-823c-63834c229f76 could not be found. Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4b8d90c9-086d-4781-823c-63834c229f76 could not be found. Apr 19 07:59:30 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-602dfd70-3ebf-4888-b4e6-bddfa6552e47 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] Returning 404 to user: Volume 4b8d90c9-086d-4781-823c-63834c229f76 could not be found. {{(pid=61210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 07:59:30 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-602dfd70-3ebf-4888-b4e6-bddfa6552e47 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/4b8d90c9-086d-4781-823c-63834c229f76" status: 404 len: 109 microversion: 2.1 time: 0.045522 Apr 19 07:59:30 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 19/57] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 07:59:30 2023] DELETE /compute/v2.1/os-volumes/4b8d90c9-086d-4781-823c-63834c229f76 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 07:59:30 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-75313b05-6fb8-4c11-9c9f-09d8df99ad20 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] Calling method '.version_select at 0x7f2c01dfcca0>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:59:30 user devstack@n-api.service[61208]: INFO nova.api.openstack.wsgi [None req-75313b05-6fb8-4c11-9c9f-09d8df99ad20 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] HTTP exception thrown: Volume 60dd206f-5dcc-4a4d-949d-d221dd6773a7 could not be found. Apr 19 07:59:30 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-75313b05-6fb8-4c11-9c9f-09d8df99ad20 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] Request method failure captured: Apr 19 07:59:30 user devstack@n-api.service[61208]: request: GET /compute/v2.1/os-volumes/60dd206f-5dcc-4a4d-949d-d221dd6773a7 HTTP/1.1 Apr 19 07:59:30 user devstack@n-api.service[61208]: Accept: application/json Apr 19 07:59:30 user devstack@n-api.service[61208]: Accept-Encoding: identity Apr 19 07:59:30 user devstack@n-api.service[61208]: Connection: close Apr 19 07:59:30 user devstack@n-api.service[61208]: Content-Length: 0 Apr 19 07:59:30 user devstack@n-api.service[61208]: Content-Type: application/json Apr 19 07:59:30 user devstack@n-api.service[61208]: Host: 10.0.0.210 Apr 19 07:59:30 user devstack@n-api.service[61208]: Openstack-System-Scope: None Apr 19 07:59:30 user devstack@n-api.service[61208]: User-Agent: python-urllib3/1.26.15 Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Auth-Token: gAAAAABkP59i1tML8vPAJSyn4JqduirQzn-1dGMJMjOUieg-t24MWrQlc-PlJP9ZKWzNKX6q9H-EjtGGUo8fGFVugZJ2NULSp2Sfp7AVhFFviZ6KIT27kX4cB8tPjehNQTlUwrpZOPaJvhHT_59bWJOz22hK6ZKD3g3F8ZSAr07D17UY3H-qzfs Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Domain-Id: None Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Domain-Name: None Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Identity-Status: Confirmed Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Is-Admin-Project: True Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Project-Domain-Id: default Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Project-Domain-Name: Default Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Project-Id: cf0c9b4586544b9ca91aaa2510f54b57 Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Project-Name: tempest-VolumesNegativeTest-9391374 Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Role: reader,member Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Roles: reader,member Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf0c9b4586544b9ca91aaa2510f54b57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cf0c9b4586544b9ca91aaa2510f54b57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cf0c9b4586544b9ca91aaa2510f54b57"}]}] Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Tenant: tempest-VolumesNegativeTest-9391374 Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Tenant-Id: cf0c9b4586544b9ca91aaa2510f54b57 Apr 19 07:59:30 user devstack@n-api.service[61208]: X-Tenant-Name: tempest-VolumesNegativeTest-9391374 Apr 19 07:59:30 user devstack@n-api.service[61208]: X-User: tempest-VolumesNegativeTest-9391374-project-member Apr 19 07:59:30 user devstack@n-api.service[61208]: X-User-Domain-Id: default Apr 19 07:59:30 user devstack@n-api.service[61208]: X-User-Domain-Name: Default Apr 19 07:59:30 user devstack@n-api.service[61208]: X-User-Id: 79a03e508ae44a6dacc7070cda00616f Apr 19 07:59:30 user devstack@n-api.service[61208]: X-User-Name: tempest-VolumesNegativeTest-9391374-project-member Apr 19 07:59:30 user devstack@n-api.service[61208]: method: Apr 19 07:59:30 user devstack@n-api.service[61208]: exception: Volume 60dd206f-5dcc-4a4d-949d-d221dd6773a7 could not be found. Apr 19 07:59:30 user devstack@n-api.service[61208]: action_args: {'id': '60dd206f-5dcc-4a4d-949d-d221dd6773a7'} Apr 19 07:59:30 user devstack@n-api.service[61208]: {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 60dd206f-5dcc-4a4d-949d-d221dd6773a7 could not be found. (HTTP 404) (Request-ID: req-5a294758-c3de-4f7b-b72c-df07a99fcab8) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 60dd206f-5dcc-4a4d-949d-d221dd6773a7 could not be found. Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 60dd206f-5dcc-4a4d-949d-d221dd6773a7 could not be found. Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 60dd206f-5dcc-4a4d-949d-d221dd6773a7 could not be found. Apr 19 07:59:30 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 07:59:30 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-75313b05-6fb8-4c11-9c9f-09d8df99ad20 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] Returning 404 to user: Volume 60dd206f-5dcc-4a4d-949d-d221dd6773a7 could not be found. {{(pid=61208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 07:59:30 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-75313b05-6fb8-4c11-9c9f-09d8df99ad20 tempest-VolumesNegativeTest-9391374 tempest-VolumesNegativeTest-9391374-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/60dd206f-5dcc-4a4d-949d-d221dd6773a7" status: 404 len: 109 microversion: 2.1 time: 0.045695 Apr 19 07:59:30 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 19/58] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 07:59:30 2023] GET /compute/v2.1/os-volumes/60dd206f-5dcc-4a4d-949d-d221dd6773a7 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 07:59:38 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-89c0daab-8db4-4a28-b745-d14e1b612e9a tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1372067185", "imageRef": "b515545f-3b22-4d80-a102-6a318ab9717a", "flavorRef": "42", "networks": [{"uuid": "9aae74c2-2560-472f-94f0-3c1cec24dfb6"}]}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:59:38 user devstack@n-api.service[61209]: DEBUG nova.network.neutron [None req-89c0daab-8db4-4a28-b745-d14e1b612e9a tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] validate_networks() for [('9aae74c2-2560-472f-94f0-3c1cec24dfb6', None, None, None, None, None)] {{(pid=61209) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 07:59:41 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-89c0daab-8db4-4a28-b745-d14e1b612e9a tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Flavor limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 07:59:41 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-89c0daab-8db4-4a28-b745-d14e1b612e9a tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Image limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 07:59:41 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-89c0daab-8db4-4a28-b745-d14e1b612e9a tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Flavor pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 07:59:41 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-89c0daab-8db4-4a28-b745-d14e1b612e9a tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Image pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 07:59:41 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-89c0daab-8db4-4a28-b745-d14e1b612e9a tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 07:59:41 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-89c0daab-8db4-4a28-b745-d14e1b612e9a tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:59:41 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-89c0daab-8db4-4a28-b745-d14e1b612e9a tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:59:41 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-89c0daab-8db4-4a28-b745-d14e1b612e9a tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:59:41 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-89c0daab-8db4-4a28-b745-d14e1b612e9a tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:59:41 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-89c0daab-8db4-4a28-b745-d14e1b612e9a tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:59:41 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-89c0daab-8db4-4a28-b745-d14e1b612e9a tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:59:41 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-89c0daab-8db4-4a28-b745-d14e1b612e9a tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Getting quotas for project be03dec99bf14fe4baa07ed4e4b7d433. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 07:59:41 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-89c0daab-8db4-4a28-b745-d14e1b612e9a tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Getting quotas for user ee39a220ed4c41d58dc529a568e4e81a and project be03dec99bf14fe4baa07ed4e4b7d433. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 07:59:41 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-89c0daab-8db4-4a28-b745-d14e1b612e9a tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Going to run 1 instances... {{(pid=61209) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 07:59:41 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-89c0daab-8db4-4a28-b745-d14e1b612e9a tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] [instance: d9311d99-6120-473a-bb42-47a0e6fb78ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b515545f-3b22-4d80-a102-6a318ab9717a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 07:59:41 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-89c0daab-8db4-4a28-b745-d14e1b612e9a tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 3.413351 Apr 19 07:59:41 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 21/59] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 07:59:38 2023] POST /compute/v2.1/servers => generated 378 bytes in 3415 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 07:59:41 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-0ca793a4-66b6-45d6-87f6-bc784b270a63 tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:59:41 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-0ca793a4-66b6-45d6-87f6-bc784b270a63 tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] [instance: d9311d99-6120-473a-bb42-47a0e6fb78ff] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 07:59:42 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-0ca793a4-66b6-45d6-87f6-bc784b270a63 tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee39a220ed4c41d58dc529a568e4e81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be03dec99bf14fe4baa07ed4e4b7d433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 07:59:42 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-0ca793a4-66b6-45d6-87f6-bc784b270a63 tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9311d99-6120-473a-bb42-47a0e6fb78ff" status: 200 len: 1209 microversion: 2.1 time: 0.262441 Apr 19 07:59:42 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 20/60] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 07:59:41 2023] GET /compute/v2.1/servers/d9311d99-6120-473a-bb42-47a0e6fb78ff => generated 1209 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 07:59:45 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-7ba99820-fa73-41fd-a626-326dc5a907a3 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-443544784", "imageRef": "b515545f-3b22-4d80-a102-6a318ab9717a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:59:45 user devstack@n-api.service[61208]: DEBUG nova.network.neutron [None req-7ba99820-fa73-41fd-a626-326dc5a907a3 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] validate_networks() for [('8dabc27a-2bdd-4dfd-9206-5cd80af65989', None, None, None, None, None)] {{(pid=61208) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 07:59:47 user devstack@n-api.service[61208]: DEBUG nova.virt.hardware [None req-7ba99820-fa73-41fd-a626-326dc5a907a3 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Flavor limits 0:0:0 {{(pid=61208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 07:59:47 user devstack@n-api.service[61208]: DEBUG nova.virt.hardware [None req-7ba99820-fa73-41fd-a626-326dc5a907a3 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Image limits 0:0:0 {{(pid=61208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 07:59:47 user devstack@n-api.service[61208]: DEBUG nova.virt.hardware [None req-7ba99820-fa73-41fd-a626-326dc5a907a3 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Flavor pref 0:0:0 {{(pid=61208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 07:59:47 user devstack@n-api.service[61208]: DEBUG nova.virt.hardware [None req-7ba99820-fa73-41fd-a626-326dc5a907a3 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Image pref 0:0:0 {{(pid=61208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 07:59:47 user devstack@n-api.service[61208]: DEBUG nova.virt.hardware [None req-7ba99820-fa73-41fd-a626-326dc5a907a3 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 07:59:47 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7ba99820-fa73-41fd-a626-326dc5a907a3 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:59:47 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7ba99820-fa73-41fd-a626-326dc5a907a3 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:59:47 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7ba99820-fa73-41fd-a626-326dc5a907a3 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:59:47 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7ba99820-fa73-41fd-a626-326dc5a907a3 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:59:47 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7ba99820-fa73-41fd-a626-326dc5a907a3 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:59:47 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7ba99820-fa73-41fd-a626-326dc5a907a3 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:59:47 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-7ba99820-fa73-41fd-a626-326dc5a907a3 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Getting quotas for project 173f7e00d8f748debe5a126203220f7f. Resources: {'ram', 'cores', 'instances'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 07:59:47 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-7ba99820-fa73-41fd-a626-326dc5a907a3 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Getting quotas for user e9796d2c200d4419b0fe67d541efc8f4 and project 173f7e00d8f748debe5a126203220f7f. Resources: {'ram', 'cores', 'instances'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 07:59:47 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-7ba99820-fa73-41fd-a626-326dc5a907a3 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Going to run 1 instances... {{(pid=61208) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 07:59:47 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-7ba99820-fa73-41fd-a626-326dc5a907a3 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] [instance: f3504e30-9be0-40b5-a53c-859dadad53a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b515545f-3b22-4d80-a102-6a318ab9717a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61208) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 07:59:47 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-7ba99820-fa73-41fd-a626-326dc5a907a3 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.179012 Apr 19 07:59:47 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 20/61] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 07:59:45 2023] POST /compute/v2.1/servers => generated 381 bytes in 2181 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 07:59:47 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-a0379f52-2527-4a2e-9203-e4411bcee372 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:59:47 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-a0379f52-2527-4a2e-9203-e4411bcee372 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] [instance: f3504e30-9be0-40b5-a53c-859dadad53a1] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 07:59:47 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-a0379f52-2527-4a2e-9203-e4411bcee372 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9796d2c200d4419b0fe67d541efc8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173f7e00d8f748debe5a126203220f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 07:59:47 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-a0379f52-2527-4a2e-9203-e4411bcee372 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3504e30-9be0-40b5-a53c-859dadad53a1" status: 200 len: 1215 microversion: 2.1 time: 0.215660 Apr 19 07:59:47 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 22/62] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 07:59:47 2023] GET /compute/v2.1/servers/f3504e30-9be0-40b5-a53c-859dadad53a1 => generated 1215 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 07:59:47 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-9e0d9cfa-a7d0-4b40-a705-ace558be3da0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1817612362", "imageRef": "b515545f-3b22-4d80-a102-6a318ab9717a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:59:48 user devstack@n-api.service[61210]: DEBUG nova.network.neutron [None req-9e0d9cfa-a7d0-4b40-a705-ace558be3da0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] validate_networks() for [('8dabc27a-2bdd-4dfd-9206-5cd80af65989', None, None, None, None, None)] {{(pid=61210) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 07:59:49 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-12a1e0a2-4d26-4747-8b7d-12b8b74a0257 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Action: 'create', calling method: .version_select at 0x7f2c01b509d0>, body: {"keypair": {"name": "tempest-keypair-2048212060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7Le4DZm5b3JAXAZsP4wbUfUdKCr/IDslwahxc/6qW0/LuzZVVB4GT1/7s5pu0QDGi+5SwCh6xTsX/cB5lAzJJI0rLZjDwBldZCtAenCFck2AxVR4TudpXJzA2OuyCwgg=="}} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:59:49 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-12a1e0a2-4d26-4747-8b7d-12b8b74a0257 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Getting quotas for project 22007f1c0da74c8aa2bfea0a0d1e1b98. Resources: {'key_pairs'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 07:59:49 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-12a1e0a2-4d26-4747-8b7d-12b8b74a0257 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Getting quotas for user 519a9c3c2f6e4c01a0115f12885554ec and project 22007f1c0da74c8aa2bfea0a0d1e1b98. Resources: {'key_pairs'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 07:59:49 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-12a1e0a2-4d26-4747-8b7d-12b8b74a0257 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.459847 Apr 19 07:59:49 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 21/63] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 07:59:48 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 07:59:49 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-9e0d9cfa-a7d0-4b40-a705-ace558be3da0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Flavor limits 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 07:59:49 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-9e0d9cfa-a7d0-4b40-a705-ace558be3da0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Image limits 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 07:59:49 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-9e0d9cfa-a7d0-4b40-a705-ace558be3da0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Flavor pref 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 07:59:49 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-9e0d9cfa-a7d0-4b40-a705-ace558be3da0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Image pref 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 07:59:49 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-9e0d9cfa-a7d0-4b40-a705-ace558be3da0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 07:59:49 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-9e0d9cfa-a7d0-4b40-a705-ace558be3da0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:59:49 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-9e0d9cfa-a7d0-4b40-a705-ace558be3da0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:59:49 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-9e0d9cfa-a7d0-4b40-a705-ace558be3da0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:59:49 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-9e0d9cfa-a7d0-4b40-a705-ace558be3da0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:59:49 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-9e0d9cfa-a7d0-4b40-a705-ace558be3da0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:59:49 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-9e0d9cfa-a7d0-4b40-a705-ace558be3da0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:59:49 user devstack@n-api.service[61210]: DEBUG nova.quota [None req-9e0d9cfa-a7d0-4b40-a705-ace558be3da0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Getting quotas for project 173f7e00d8f748debe5a126203220f7f. Resources: {'ram', 'cores', 'instances'} {{(pid=61210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 07:59:49 user devstack@n-api.service[61210]: DEBUG nova.quota [None req-9e0d9cfa-a7d0-4b40-a705-ace558be3da0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Getting quotas for user e9796d2c200d4419b0fe67d541efc8f4 and project 173f7e00d8f748debe5a126203220f7f. Resources: {'ram', 'cores', 'instances'} {{(pid=61210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 07:59:50 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-9e0d9cfa-a7d0-4b40-a705-ace558be3da0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Going to run 1 instances... {{(pid=61210) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 07:59:50 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-9e0d9cfa-a7d0-4b40-a705-ace558be3da0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] [instance: a36b83d3-7114-49dc-9632-48c0dacafbf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b515545f-3b22-4d80-a102-6a318ab9717a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 07:59:50 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-9e0d9cfa-a7d0-4b40-a705-ace558be3da0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.182039 Apr 19 07:59:50 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 21/64] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 07:59:47 2023] POST /compute/v2.1/servers => generated 381 bytes in 2184 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 19 07:59:50 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-e77846e1-7459-4a75-8a69-ea97c5040337 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:59:50 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-e77846e1-7459-4a75-8a69-ea97c5040337 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] [instance: a36b83d3-7114-49dc-9632-48c0dacafbf8] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 07:59:50 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-e77846e1-7459-4a75-8a69-ea97c5040337 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9796d2c200d4419b0fe67d541efc8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173f7e00d8f748debe5a126203220f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 07:59:50 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-e77846e1-7459-4a75-8a69-ea97c5040337 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a36b83d3-7114-49dc-9632-48c0dacafbf8" status: 200 len: 1216 microversion: 2.1 time: 0.092089 Apr 19 07:59:50 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 23/65] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 07:59:50 2023] GET /compute/v2.1/servers/a36b83d3-7114-49dc-9632-48c0dacafbf8 => generated 1216 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 07:59:50 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-7b9e19ca-e59d-4c4b-b1cf-7896ae35a019 req-730399cd-e2ee-44cf-9256-55a46db922bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9311d99-6120-473a-bb42-47a0e6fb78ff", "tag": "459b47f8-a672-4fc3-9e57-e10f0cd305fa"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:59:50 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-7b9e19ca-e59d-4c4b-b1cf-7896ae35a019 req-730399cd-e2ee-44cf-9256-55a46db922bd service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:59:50 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-7b9e19ca-e59d-4c4b-b1cf-7896ae35a019 req-730399cd-e2ee-44cf-9256-55a46db922bd service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:59:50 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-7b9e19ca-e59d-4c4b-b1cf-7896ae35a019 req-730399cd-e2ee-44cf-9256-55a46db922bd service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:59:50 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-7b9e19ca-e59d-4c4b-b1cf-7896ae35a019 req-730399cd-e2ee-44cf-9256-55a46db922bd service nova] Creating event network-changed:459b47f8-a672-4fc3-9e57-e10f0cd305fa for instance d9311d99-6120-473a-bb42-47a0e6fb78ff on user Apr 19 07:59:50 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-7b9e19ca-e59d-4c4b-b1cf-7896ae35a019 req-730399cd-e2ee-44cf-9256-55a46db922bd service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61208) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 19 07:59:50 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-7b9e19ca-e59d-4c4b-b1cf-7896ae35a019 req-730399cd-e2ee-44cf-9256-55a46db922bd service nova] Acquired lock "compute-rpcapi-router" {{(pid=61208) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 19 07:59:50 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-38f2feb2-a34c-46be-9fba-5b5c817af890 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:59:50 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-38f2feb2-a34c-46be-9fba-5b5c817af890 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:59:50 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-38f2feb2-a34c-46be-9fba-5b5c817af890 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:59:50 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-38f2feb2-a34c-46be-9fba-5b5c817af890 None None] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:59:50 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-38f2feb2-a34c-46be-9fba-5b5c817af890 None None] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:59:50 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-38f2feb2-a34c-46be-9fba-5b5c817af890 None None] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:59:50 user devstack@n-api.service[61208]: INFO nova.compute.rpcapi [None req-38f2feb2-a34c-46be-9fba-5b5c817af890 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 19 07:59:50 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-38f2feb2-a34c-46be-9fba-5b5c817af890 None None] Releasing lock "compute-rpcapi-router" {{(pid=61208) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 19 07:59:50 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-38f2feb2-a34c-46be-9fba-5b5c817af890 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227957 Apr 19 07:59:50 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 22/66] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 07:59:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 07:59:55 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-d9ed50d6-aa12-424d-aa84-4b1f0e079422 req-4d0f60ac-55e8-4dc8-b319-4dbfb22689fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3504e30-9be0-40b5-a53c-859dadad53a1", "tag": "f15126e6-928c-4edf-ad46-3ad97be876be"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:59:55 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-d9ed50d6-aa12-424d-aa84-4b1f0e079422 req-4d0f60ac-55e8-4dc8-b319-4dbfb22689fd service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:59:55 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-d9ed50d6-aa12-424d-aa84-4b1f0e079422 req-4d0f60ac-55e8-4dc8-b319-4dbfb22689fd service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:59:55 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-d9ed50d6-aa12-424d-aa84-4b1f0e079422 req-4d0f60ac-55e8-4dc8-b319-4dbfb22689fd service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:59:55 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-d9ed50d6-aa12-424d-aa84-4b1f0e079422 req-4d0f60ac-55e8-4dc8-b319-4dbfb22689fd service nova] Creating event network-changed:f15126e6-928c-4edf-ad46-3ad97be876be for instance f3504e30-9be0-40b5-a53c-859dadad53a1 on user Apr 19 07:59:55 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-d9ed50d6-aa12-424d-aa84-4b1f0e079422 req-4d0f60ac-55e8-4dc8-b319-4dbfb22689fd service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61210) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 19 07:59:55 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-d9ed50d6-aa12-424d-aa84-4b1f0e079422 req-4d0f60ac-55e8-4dc8-b319-4dbfb22689fd service nova] Acquired lock "compute-rpcapi-router" {{(pid=61210) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 19 07:59:55 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f139184b-25e1-4146-92bc-71f5673a458a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:59:55 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f139184b-25e1-4146-92bc-71f5673a458a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:59:55 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f139184b-25e1-4146-92bc-71f5673a458a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:59:55 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f139184b-25e1-4146-92bc-71f5673a458a None None] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:59:55 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f139184b-25e1-4146-92bc-71f5673a458a None None] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:59:55 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f139184b-25e1-4146-92bc-71f5673a458a None None] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:59:55 user devstack@n-api.service[61210]: INFO nova.compute.rpcapi [None req-f139184b-25e1-4146-92bc-71f5673a458a None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 19 07:59:55 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f139184b-25e1-4146-92bc-71f5673a458a None None] Releasing lock "compute-rpcapi-router" {{(pid=61210) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 19 07:59:56 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-f139184b-25e1-4146-92bc-71f5673a458a None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191149 Apr 19 07:59:56 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 22/67] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 07:59:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 07:59:56 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-1546aeea-c4a6-491c-9196-8775abf1d0b9 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-690090123", "imageRef": "b515545f-3b22-4d80-a102-6a318ab9717a", "flavorRef": "42", "networks": [{"uuid": "7cabadd7-718d-4dd6-a4d4-331e3d71d439"}], "security_groups": [{"name": "tempest-securitygroup--490146923"}], "key_name": "tempest-keypair-2048212060", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:59:56 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 07:59:56 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 07:59:56 user devstack@n-api.service[61209]: DEBUG nova.network.neutron [None req-1546aeea-c4a6-491c-9196-8775abf1d0b9 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] validate_networks() for [('7cabadd7-718d-4dd6-a4d4-331e3d71d439', None, None, None, None, None)] {{(pid=61209) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 07:59:58 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-cf3aade4-d3ce-4038-9620-a951f6a6ae53 req-994f2652-11d9-45ce-94c5-e29bd1321daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9311d99-6120-473a-bb42-47a0e6fb78ff", "name": "network-vif-plugged", "status": "completed", "tag": "459b47f8-a672-4fc3-9e57-e10f0cd305fa"}, {"server_uuid": "d9311d99-6120-473a-bb42-47a0e6fb78ff", "name": "network-vif-plugged", "status": "completed", "tag": "459b47f8-a672-4fc3-9e57-e10f0cd305fa"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:59:58 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-cf3aade4-d3ce-4038-9620-a951f6a6ae53 req-994f2652-11d9-45ce-94c5-e29bd1321daa service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:59:58 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-cf3aade4-d3ce-4038-9620-a951f6a6ae53 req-994f2652-11d9-45ce-94c5-e29bd1321daa service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:59:58 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-cf3aade4-d3ce-4038-9620-a951f6a6ae53 req-994f2652-11d9-45ce-94c5-e29bd1321daa service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:59:58 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-cf3aade4-d3ce-4038-9620-a951f6a6ae53 req-994f2652-11d9-45ce-94c5-e29bd1321daa service nova] Creating event network-vif-plugged:459b47f8-a672-4fc3-9e57-e10f0cd305fa for instance d9311d99-6120-473a-bb42-47a0e6fb78ff on user Apr 19 07:59:58 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-cf3aade4-d3ce-4038-9620-a951f6a6ae53 req-994f2652-11d9-45ce-94c5-e29bd1321daa service nova] Creating event network-vif-plugged:459b47f8-a672-4fc3-9e57-e10f0cd305fa for instance d9311d99-6120-473a-bb42-47a0e6fb78ff on user Apr 19 07:59:58 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-cf3aade4-d3ce-4038-9620-a951f6a6ae53 req-994f2652-11d9-45ce-94c5-e29bd1321daa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035718 Apr 19 07:59:58 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 23/68] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 07:59:58 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 07:59:58 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-1546aeea-c4a6-491c-9196-8775abf1d0b9 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Flavor limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 07:59:58 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-1546aeea-c4a6-491c-9196-8775abf1d0b9 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Image limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 07:59:58 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-1546aeea-c4a6-491c-9196-8775abf1d0b9 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Flavor pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 07:59:58 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-1546aeea-c4a6-491c-9196-8775abf1d0b9 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Image pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 07:59:58 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-1546aeea-c4a6-491c-9196-8775abf1d0b9 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 07:59:58 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-1546aeea-c4a6-491c-9196-8775abf1d0b9 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:59:58 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-1546aeea-c4a6-491c-9196-8775abf1d0b9 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:59:58 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-1546aeea-c4a6-491c-9196-8775abf1d0b9 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:59:58 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-1546aeea-c4a6-491c-9196-8775abf1d0b9 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:59:58 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-1546aeea-c4a6-491c-9196-8775abf1d0b9 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:59:58 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-1546aeea-c4a6-491c-9196-8775abf1d0b9 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:59:58 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-1546aeea-c4a6-491c-9196-8775abf1d0b9 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Getting quotas for project 22007f1c0da74c8aa2bfea0a0d1e1b98. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 07:59:58 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-1546aeea-c4a6-491c-9196-8775abf1d0b9 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Getting quotas for user 519a9c3c2f6e4c01a0115f12885554ec and project 22007f1c0da74c8aa2bfea0a0d1e1b98. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 07:59:58 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-1546aeea-c4a6-491c-9196-8775abf1d0b9 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Going to run 1 instances... {{(pid=61209) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 07:59:58 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-1546aeea-c4a6-491c-9196-8775abf1d0b9 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] [instance: 396bea78-4da8-4d59-b595-4617e997a3a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b515545f-3b22-4d80-a102-6a318ab9717a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 07:59:58 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-1546aeea-c4a6-491c-9196-8775abf1d0b9 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.227768 Apr 19 07:59:58 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 24/69] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 07:59:56 2023] POST /compute/v2.1/servers => generated 403 bytes in 2230 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 07:59:58 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-2c1571cd-23d5-4448-8e41-262aa59899d4 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 07:59:58 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-2c1571cd-23d5-4448-8e41-262aa59899d4 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] [instance: 396bea78-4da8-4d59-b595-4617e997a3a0] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 07:59:58 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-2c1571cd-23d5-4448-8e41-262aa59899d4 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519a9c3c2f6e4c01a0115f12885554ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22007f1c0da74c8aa2bfea0a0d1e1b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 07:59:58 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-2c1571cd-23d5-4448-8e41-262aa59899d4 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] 10.0.0.210 "GET /compute/v2.1/servers/396bea78-4da8-4d59-b595-4617e997a3a0" status: 200 len: 1239 microversion: 2.1 time: 0.275734 Apr 19 07:59:58 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 23/70] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 07:59:58 2023] GET /compute/v2.1/servers/396bea78-4da8-4d59-b595-4617e997a3a0 => generated 1239 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 07:59:59 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-52649dfd-8667-4971-aa3e-62128271a881 req-7302c8ca-6179-4892-bc91-71414b1c21b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a36b83d3-7114-49dc-9632-48c0dacafbf8", "tag": "f80986be-013a-49c0-bb54-96d55ce82748"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 07:59:59 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-52649dfd-8667-4971-aa3e-62128271a881 req-7302c8ca-6179-4892-bc91-71414b1c21b2 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 07:59:59 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-52649dfd-8667-4971-aa3e-62128271a881 req-7302c8ca-6179-4892-bc91-71414b1c21b2 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 07:59:59 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-52649dfd-8667-4971-aa3e-62128271a881 req-7302c8ca-6179-4892-bc91-71414b1c21b2 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 07:59:59 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-52649dfd-8667-4971-aa3e-62128271a881 req-7302c8ca-6179-4892-bc91-71414b1c21b2 service nova] Creating event network-changed:f80986be-013a-49c0-bb54-96d55ce82748 for instance a36b83d3-7114-49dc-9632-48c0dacafbf8 on user Apr 19 07:59:59 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-52649dfd-8667-4971-aa3e-62128271a881 req-7302c8ca-6179-4892-bc91-71414b1c21b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119035 Apr 19 07:59:59 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 24/71] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 07:59:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:01 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-9fab325c-184b-497b-8361-41f74c300b2d req-c163e24b-023c-4887-a8f5-654f9b8c26ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3504e30-9be0-40b5-a53c-859dadad53a1", "name": "network-vif-plugged", "status": "completed", "tag": "f15126e6-928c-4edf-ad46-3ad97be876be"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:01 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-9fab325c-184b-497b-8361-41f74c300b2d req-c163e24b-023c-4887-a8f5-654f9b8c26ce service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:01 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-9fab325c-184b-497b-8361-41f74c300b2d req-c163e24b-023c-4887-a8f5-654f9b8c26ce service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:01 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-9fab325c-184b-497b-8361-41f74c300b2d req-c163e24b-023c-4887-a8f5-654f9b8c26ce service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:01 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-9fab325c-184b-497b-8361-41f74c300b2d req-c163e24b-023c-4887-a8f5-654f9b8c26ce service nova] Creating event network-vif-plugged:f15126e6-928c-4edf-ad46-3ad97be876be for instance f3504e30-9be0-40b5-a53c-859dadad53a1 on user Apr 19 08:00:01 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-9fab325c-184b-497b-8361-41f74c300b2d req-c163e24b-023c-4887-a8f5-654f9b8c26ce service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61209) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 19 08:00:01 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-9fab325c-184b-497b-8361-41f74c300b2d req-c163e24b-023c-4887-a8f5-654f9b8c26ce service nova] Acquired lock "compute-rpcapi-router" {{(pid=61209) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 19 08:00:01 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-32bd50e4-afa5-450f-ac87-df0a8e21edd5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:01 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-32bd50e4-afa5-450f-ac87-df0a8e21edd5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:01 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-32bd50e4-afa5-450f-ac87-df0a8e21edd5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:01 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-32bd50e4-afa5-450f-ac87-df0a8e21edd5 None None] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:01 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-32bd50e4-afa5-450f-ac87-df0a8e21edd5 None None] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:01 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-32bd50e4-afa5-450f-ac87-df0a8e21edd5 None None] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:01 user devstack@n-api.service[61209]: INFO nova.compute.rpcapi [None req-32bd50e4-afa5-450f-ac87-df0a8e21edd5 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 19 08:00:01 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-32bd50e4-afa5-450f-ac87-df0a8e21edd5 None None] Releasing lock "compute-rpcapi-router" {{(pid=61209) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 19 08:00:01 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-32bd50e4-afa5-450f-ac87-df0a8e21edd5 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117872 Apr 19 08:00:01 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 25/72] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:00:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:02 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-9c3417da-31e9-4a53-a91f-ab942bc3f24f req-dc667ec5-7e6f-45f4-a59f-89c055f45456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36b83d3-7114-49dc-9632-48c0dacafbf8", "name": "network-vif-plugged", "status": "completed", "tag": "f80986be-013a-49c0-bb54-96d55ce82748"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:02 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-9c3417da-31e9-4a53-a91f-ab942bc3f24f req-dc667ec5-7e6f-45f4-a59f-89c055f45456 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:02 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-9c3417da-31e9-4a53-a91f-ab942bc3f24f req-dc667ec5-7e6f-45f4-a59f-89c055f45456 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:02 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-9c3417da-31e9-4a53-a91f-ab942bc3f24f req-dc667ec5-7e6f-45f4-a59f-89c055f45456 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:02 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-9c3417da-31e9-4a53-a91f-ab942bc3f24f req-dc667ec5-7e6f-45f4-a59f-89c055f45456 service nova] Creating event network-vif-plugged:f80986be-013a-49c0-bb54-96d55ce82748 for instance a36b83d3-7114-49dc-9632-48c0dacafbf8 on user Apr 19 08:00:02 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-9c3417da-31e9-4a53-a91f-ab942bc3f24f req-dc667ec5-7e6f-45f4-a59f-89c055f45456 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044427 Apr 19 08:00:02 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 24/73] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:00:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:03 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=10 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:00:03 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=4 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:00:03 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-89ef1cfe-55ef-4ba8-b58b-13e5e99b975c req-41eaa30a-910f-4e46-ba32-43bc8bb6d1ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3504e30-9be0-40b5-a53c-859dadad53a1", "name": "network-vif-plugged", "status": "completed", "tag": "f15126e6-928c-4edf-ad46-3ad97be876be"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:03 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-89ef1cfe-55ef-4ba8-b58b-13e5e99b975c req-41eaa30a-910f-4e46-ba32-43bc8bb6d1ab service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:03 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-89ef1cfe-55ef-4ba8-b58b-13e5e99b975c req-41eaa30a-910f-4e46-ba32-43bc8bb6d1ab service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:03 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-89ef1cfe-55ef-4ba8-b58b-13e5e99b975c req-41eaa30a-910f-4e46-ba32-43bc8bb6d1ab service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:03 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-89ef1cfe-55ef-4ba8-b58b-13e5e99b975c req-41eaa30a-910f-4e46-ba32-43bc8bb6d1ab service nova] Creating event network-vif-plugged:f15126e6-928c-4edf-ad46-3ad97be876be for instance f3504e30-9be0-40b5-a53c-859dadad53a1 on user Apr 19 08:00:03 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-89ef1cfe-55ef-4ba8-b58b-13e5e99b975c req-41eaa30a-910f-4e46-ba32-43bc8bb6d1ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101799 Apr 19 08:00:03 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 25/74] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:00:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:04 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-9a03b124-001f-45c2-b210-da24d379de8a req-7355dc10-19c0-4d34-a1ab-6feeec391b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36b83d3-7114-49dc-9632-48c0dacafbf8", "name": "network-vif-plugged", "status": "completed", "tag": "f80986be-013a-49c0-bb54-96d55ce82748"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:04 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-9a03b124-001f-45c2-b210-da24d379de8a req-7355dc10-19c0-4d34-a1ab-6feeec391b29 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:04 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-9a03b124-001f-45c2-b210-da24d379de8a req-7355dc10-19c0-4d34-a1ab-6feeec391b29 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:04 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-9a03b124-001f-45c2-b210-da24d379de8a req-7355dc10-19c0-4d34-a1ab-6feeec391b29 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:04 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-9a03b124-001f-45c2-b210-da24d379de8a req-7355dc10-19c0-4d34-a1ab-6feeec391b29 service nova] Creating event network-vif-plugged:f80986be-013a-49c0-bb54-96d55ce82748 for instance a36b83d3-7114-49dc-9632-48c0dacafbf8 on user Apr 19 08:00:04 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-9a03b124-001f-45c2-b210-da24d379de8a req-7355dc10-19c0-4d34-a1ab-6feeec391b29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070692 Apr 19 08:00:04 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 26/75] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:00:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:07 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-63d7cd32-8f68-42d7-b528-72570a04f88a req-68f96355-4426-4ec2-bb6e-67227f3f2f60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "396bea78-4da8-4d59-b595-4617e997a3a0", "tag": "12688fad-698e-449f-870c-d3e7e2e603da"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:07 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell0:SELECT=4 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:00:07 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-63d7cd32-8f68-42d7-b528-72570a04f88a req-68f96355-4426-4ec2-bb6e-67227f3f2f60 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:07 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-63d7cd32-8f68-42d7-b528-72570a04f88a req-68f96355-4426-4ec2-bb6e-67227f3f2f60 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:07 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-63d7cd32-8f68-42d7-b528-72570a04f88a req-68f96355-4426-4ec2-bb6e-67227f3f2f60 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:07 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-63d7cd32-8f68-42d7-b528-72570a04f88a req-68f96355-4426-4ec2-bb6e-67227f3f2f60 service nova] Creating event network-changed:12688fad-698e-449f-870c-d3e7e2e603da for instance 396bea78-4da8-4d59-b595-4617e997a3a0 on user Apr 19 08:00:07 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-63d7cd32-8f68-42d7-b528-72570a04f88a req-68f96355-4426-4ec2-bb6e-67227f3f2f60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060320 Apr 19 08:00:07 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 25/76] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:00:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:08 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-6a1a965f-39f9-4836-b309-f4127c67d6a9 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Action: 'create', calling method: .version_select at 0x7f2c01bc9f30>, body: {"keypair": {"name": "tempest-keypair-1837993463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHS064Koenz8b6n/zM5OZTScD7D35vhn6Qr4wJq1LJoe0nFCWy65dHvaWmkmBxVRrNzy6eJ7pvNNjZ52RMQ4zlthaJQRSt3S+02i4Flq+va1gmNfQgCX9HPO+5b7na+OxQ=="}} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:08 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-6a1a965f-39f9-4836-b309-f4127c67d6a9 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Getting quotas for project 616eae3faffb4aaa9fbdae47ea8d5cba. Resources: {'key_pairs'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:00:08 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-6a1a965f-39f9-4836-b309-f4127c67d6a9 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Getting quotas for user 2b62de8ca3994e54ae9c9cd891a8f4fe and project 616eae3faffb4aaa9fbdae47ea8d5cba. Resources: {'key_pairs'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:00:08 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-6a1a965f-39f9-4836-b309-f4127c67d6a9 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.309892 Apr 19 08:00:08 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 26/77] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 08:00:08 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:11 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-ca243dc7-ad4c-4402-957d-0906ebc395e5 req-2c51e304-2938-4840-b758-4a22232ef9fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "396bea78-4da8-4d59-b595-4617e997a3a0", "name": "network-vif-plugged", "status": "completed", "tag": "12688fad-698e-449f-870c-d3e7e2e603da"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:11 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=16 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:00:11 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=4 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:00:11 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=6 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:00:11 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-ca243dc7-ad4c-4402-957d-0906ebc395e5 req-2c51e304-2938-4840-b758-4a22232ef9fc service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:11 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-ca243dc7-ad4c-4402-957d-0906ebc395e5 req-2c51e304-2938-4840-b758-4a22232ef9fc service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:11 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-ca243dc7-ad4c-4402-957d-0906ebc395e5 req-2c51e304-2938-4840-b758-4a22232ef9fc service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:11 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-ca243dc7-ad4c-4402-957d-0906ebc395e5 req-2c51e304-2938-4840-b758-4a22232ef9fc service nova] Creating event network-vif-plugged:12688fad-698e-449f-870c-d3e7e2e603da for instance 396bea78-4da8-4d59-b595-4617e997a3a0 on user Apr 19 08:00:11 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-ca243dc7-ad4c-4402-957d-0906ebc395e5 req-2c51e304-2938-4840-b758-4a22232ef9fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072720 Apr 19 08:00:11 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 27/78] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:00:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:13 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell0:SELECT=10 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:00:13 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-445c33c8-c5fb-42d3-a94f-1acf78b8bfc8 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-513468572", "imageRef": "ffd18089-7b15-47d9-9121-458f0775df9d", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "caec9a8e-a676-4bc0-92c5-e9f4343c100d"}], "security_groups": [{"name": "tempest-securitygroup--1487262396"}], "key_name": "tempest-keypair-1837993463", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:13 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:00:13 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-c5ab3928-8e63-43c2-90b0-63a1cad16427 req-5181dc5e-201e-446c-a9b4-8fa514678e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "396bea78-4da8-4d59-b595-4617e997a3a0", "name": "network-vif-plugged", "status": "completed", "tag": "12688fad-698e-449f-870c-d3e7e2e603da"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:13 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=12 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:00:13 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-c5ab3928-8e63-43c2-90b0-63a1cad16427 req-5181dc5e-201e-446c-a9b4-8fa514678e65 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:13 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-c5ab3928-8e63-43c2-90b0-63a1cad16427 req-5181dc5e-201e-446c-a9b4-8fa514678e65 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:13 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-c5ab3928-8e63-43c2-90b0-63a1cad16427 req-5181dc5e-201e-446c-a9b4-8fa514678e65 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:13 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-c5ab3928-8e63-43c2-90b0-63a1cad16427 req-5181dc5e-201e-446c-a9b4-8fa514678e65 service nova] Creating event network-vif-plugged:12688fad-698e-449f-870c-d3e7e2e603da for instance 396bea78-4da8-4d59-b595-4617e997a3a0 on user Apr 19 08:00:13 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-c5ab3928-8e63-43c2-90b0-63a1cad16427 req-5181dc5e-201e-446c-a9b4-8fa514678e65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047514 Apr 19 08:00:13 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 27/79] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:00:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:13 user devstack@n-api.service[61210]: DEBUG nova.network.neutron [None req-445c33c8-c5fb-42d3-a94f-1acf78b8bfc8 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] validate_networks() for [('caec9a8e-a676-4bc0-92c5-e9f4343c100d', None, None, None, None, None)] {{(pid=61210) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 08:00:15 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-01a27a50-b8e1-40a0-8abe-3750f70150c8 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Action: 'create', calling method: .version_select at 0x7f2c01be23b0>, body: {"keypair": {"name": "tempest-keypair-1467729423", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNl8TYhaK0u/m8kq2bmirKAoRTJi5rAm9EwuT3PXoIDB+uRgfHpSs7FGbQjJo7E/335YBaypSVnr6fjB4Yn4m901V0VGo0KX9U5/BseDcreCN6kMV5YHXyaCuCBncEMabw=="}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:15 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-01a27a50-b8e1-40a0-8abe-3750f70150c8 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Getting quotas for project 463fd5763cb24abeae209399cb8ff073. Resources: {'key_pairs'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:00:15 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-01a27a50-b8e1-40a0-8abe-3750f70150c8 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Getting quotas for user c38ef0fdb3c84ba9948b0806fd74f279 and project 463fd5763cb24abeae209399cb8ff073. Resources: {'key_pairs'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:00:15 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-01a27a50-b8e1-40a0-8abe-3750f70150c8 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.536607 Apr 19 08:00:15 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 28/80] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 08:00:15 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:15 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-445c33c8-c5fb-42d3-a94f-1acf78b8bfc8 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Flavor limits 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 08:00:15 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-445c33c8-c5fb-42d3-a94f-1acf78b8bfc8 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Image limits 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 08:00:15 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-445c33c8-c5fb-42d3-a94f-1acf78b8bfc8 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Flavor pref 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 08:00:15 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-445c33c8-c5fb-42d3-a94f-1acf78b8bfc8 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Image pref 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 08:00:15 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-445c33c8-c5fb-42d3-a94f-1acf78b8bfc8 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 08:00:16 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-445c33c8-c5fb-42d3-a94f-1acf78b8bfc8 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:16 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-445c33c8-c5fb-42d3-a94f-1acf78b8bfc8 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:16 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-445c33c8-c5fb-42d3-a94f-1acf78b8bfc8 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:16 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-445c33c8-c5fb-42d3-a94f-1acf78b8bfc8 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:16 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-445c33c8-c5fb-42d3-a94f-1acf78b8bfc8 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:16 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-445c33c8-c5fb-42d3-a94f-1acf78b8bfc8 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:16 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=11 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:00:16 user devstack@n-api.service[61210]: DEBUG nova.quota [None req-445c33c8-c5fb-42d3-a94f-1acf78b8bfc8 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Getting quotas for project 616eae3faffb4aaa9fbdae47ea8d5cba. Resources: {'ram', 'cores', 'instances'} {{(pid=61210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:00:16 user devstack@n-api.service[61210]: DEBUG nova.quota [None req-445c33c8-c5fb-42d3-a94f-1acf78b8bfc8 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Getting quotas for user 2b62de8ca3994e54ae9c9cd891a8f4fe and project 616eae3faffb4aaa9fbdae47ea8d5cba. Resources: {'ram', 'cores', 'instances'} {{(pid=61210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:00:16 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-445c33c8-c5fb-42d3-a94f-1acf78b8bfc8 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Going to run 1 instances... {{(pid=61210) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 08:00:16 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-445c33c8-c5fb-42d3-a94f-1acf78b8bfc8 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] [instance: 47562492-07e0-43cb-979a-fd904c3bcf6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ffd18089-7b15-47d9-9121-458f0775df9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 08:00:16 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-445c33c8-c5fb-42d3-a94f-1acf78b8bfc8 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.387930 Apr 19 08:00:16 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 26/81] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 08:00:13 2023] POST /compute/v2.1/servers => generated 404 bytes in 2391 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 08:00:16 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-39762899-42fc-45fd-8480-32b05e8e3d3b tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:00:16 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-39762899-42fc-45fd-8480-32b05e8e3d3b tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] [instance: 47562492-07e0-43cb-979a-fd904c3bcf6c] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:00:16 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=5 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:00:16 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-39762899-42fc-45fd-8480-32b05e8e3d3b tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b62de8ca3994e54ae9c9cd891a8f4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616eae3faffb4aaa9fbdae47ea8d5cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:00:16 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-39762899-42fc-45fd-8480-32b05e8e3d3b tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47562492-07e0-43cb-979a-fd904c3bcf6c" status: 200 len: 1239 microversion: 2.1 time: 0.447940 Apr 19 08:00:16 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 28/82] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:00:16 2023] GET /compute/v2.1/servers/47562492-07e0-43cb-979a-fd904c3bcf6c => generated 1239 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:00:18 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-3c6da1ed-10e1-47ec-afb2-ac672332b627 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1629038264", "imageRef": "b515545f-3b22-4d80-a102-6a318ab9717a", "flavorRef": "42", "networks": [{"uuid": "6b5acefb-31b4-419b-92ef-02b730d2a899"}], "security_groups": [{"name": "tempest-securitygroup--1422142725"}], "key_name": "tempest-keypair-1467729423", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:18 user devstack@n-api.service[61209]: DEBUG nova.network.neutron [None req-3c6da1ed-10e1-47ec-afb2-ac672332b627 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] validate_networks() for [('6b5acefb-31b4-419b-92ef-02b730d2a899', None, None, None, None, None)] {{(pid=61209) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 08:00:20 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-3c6da1ed-10e1-47ec-afb2-ac672332b627 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Flavor limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 08:00:20 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-3c6da1ed-10e1-47ec-afb2-ac672332b627 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Image limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 08:00:20 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-3c6da1ed-10e1-47ec-afb2-ac672332b627 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Flavor pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 08:00:20 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-3c6da1ed-10e1-47ec-afb2-ac672332b627 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Image pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 08:00:20 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-3c6da1ed-10e1-47ec-afb2-ac672332b627 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 08:00:20 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-3c6da1ed-10e1-47ec-afb2-ac672332b627 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:20 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-3c6da1ed-10e1-47ec-afb2-ac672332b627 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:20 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-3c6da1ed-10e1-47ec-afb2-ac672332b627 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:20 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-3c6da1ed-10e1-47ec-afb2-ac672332b627 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:20 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-3c6da1ed-10e1-47ec-afb2-ac672332b627 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:20 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-3c6da1ed-10e1-47ec-afb2-ac672332b627 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:20 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-3c6da1ed-10e1-47ec-afb2-ac672332b627 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Getting quotas for project 463fd5763cb24abeae209399cb8ff073. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:00:20 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-3c6da1ed-10e1-47ec-afb2-ac672332b627 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Getting quotas for user c38ef0fdb3c84ba9948b0806fd74f279 and project 463fd5763cb24abeae209399cb8ff073. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:00:20 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-3c6da1ed-10e1-47ec-afb2-ac672332b627 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Going to run 1 instances... {{(pid=61209) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 08:00:20 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-3c6da1ed-10e1-47ec-afb2-ac672332b627 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] [instance: 4fae3aae-cb67-4c14-b358-59248d99238d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b515545f-3b22-4d80-a102-6a318ab9717a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 08:00:20 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-3c6da1ed-10e1-47ec-afb2-ac672332b627 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.302259 Apr 19 08:00:20 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 29/83] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 08:00:18 2023] POST /compute/v2.1/servers => generated 404 bytes in 2304 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 08:00:20 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-d4a47f9c-e81a-45b7-a531-6984f32259c5 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:00:20 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-d4a47f9c-e81a-45b7-a531-6984f32259c5 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] [instance: 4fae3aae-cb67-4c14-b358-59248d99238d] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:00:20 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-d4a47f9c-e81a-45b7-a531-6984f32259c5 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef0fdb3c84ba9948b0806fd74f279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463fd5763cb24abeae209399cb8ff073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:00:20 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-d4a47f9c-e81a-45b7-a531-6984f32259c5 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fae3aae-cb67-4c14-b358-59248d99238d" status: 200 len: 1236 microversion: 2.1 time: 0.098634 Apr 19 08:00:20 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 27/84] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:00:20 2023] GET /compute/v2.1/servers/4fae3aae-cb67-4c14-b358-59248d99238d => generated 1236 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:00:21 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-c0895ba1-98d5-4e5d-9913-f4af2e8b1a9e req-e4589c41-7385-4038-9754-f11786a11721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47562492-07e0-43cb-979a-fd904c3bcf6c", "tag": "9aaae4fb-7881-479b-a7a4-10d4d96a3aff"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:21 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-c0895ba1-98d5-4e5d-9913-f4af2e8b1a9e req-e4589c41-7385-4038-9754-f11786a11721 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:21 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-c0895ba1-98d5-4e5d-9913-f4af2e8b1a9e req-e4589c41-7385-4038-9754-f11786a11721 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:21 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-c0895ba1-98d5-4e5d-9913-f4af2e8b1a9e req-e4589c41-7385-4038-9754-f11786a11721 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:21 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-c0895ba1-98d5-4e5d-9913-f4af2e8b1a9e req-e4589c41-7385-4038-9754-f11786a11721 service nova] Creating event network-changed:9aaae4fb-7881-479b-a7a4-10d4d96a3aff for instance 47562492-07e0-43cb-979a-fd904c3bcf6c on user Apr 19 08:00:21 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-c0895ba1-98d5-4e5d-9913-f4af2e8b1a9e req-e4589c41-7385-4038-9754-f11786a11721 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036270 Apr 19 08:00:21 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 29/85] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:00:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:26 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-90327e9b-1cb1-4c3f-8e61-a537517fdcc7 req-52c46626-9984-4575-a7ce-954f955d426e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47562492-07e0-43cb-979a-fd904c3bcf6c", "name": "network-vif-plugged", "status": "completed", "tag": "9aaae4fb-7881-479b-a7a4-10d4d96a3aff"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:26 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-90327e9b-1cb1-4c3f-8e61-a537517fdcc7 req-52c46626-9984-4575-a7ce-954f955d426e service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:26 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-90327e9b-1cb1-4c3f-8e61-a537517fdcc7 req-52c46626-9984-4575-a7ce-954f955d426e service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:26 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-90327e9b-1cb1-4c3f-8e61-a537517fdcc7 req-52c46626-9984-4575-a7ce-954f955d426e service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:26 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=13 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:00:26 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-90327e9b-1cb1-4c3f-8e61-a537517fdcc7 req-52c46626-9984-4575-a7ce-954f955d426e service nova] Creating event network-vif-plugged:9aaae4fb-7881-479b-a7a4-10d4d96a3aff for instance 47562492-07e0-43cb-979a-fd904c3bcf6c on user Apr 19 08:00:26 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-90327e9b-1cb1-4c3f-8e61-a537517fdcc7 req-52c46626-9984-4575-a7ce-954f955d426e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046881 Apr 19 08:00:26 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 30/86] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:00:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:28 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-d1c15b08-2e66-458f-82fe-b4b17dcf9c48 req-593ddbee-3679-4795-85d8-f9712e9d2754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fae3aae-cb67-4c14-b358-59248d99238d", "tag": "0099c8b1-71b7-45a0-abe2-aeecf2e3e73b"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:28 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell0:SELECT=2 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:00:28 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=1 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:00:28 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-d1c15b08-2e66-458f-82fe-b4b17dcf9c48 req-593ddbee-3679-4795-85d8-f9712e9d2754 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:28 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-d1c15b08-2e66-458f-82fe-b4b17dcf9c48 req-593ddbee-3679-4795-85d8-f9712e9d2754 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:28 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-d1c15b08-2e66-458f-82fe-b4b17dcf9c48 req-593ddbee-3679-4795-85d8-f9712e9d2754 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:28 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-d1c15b08-2e66-458f-82fe-b4b17dcf9c48 req-593ddbee-3679-4795-85d8-f9712e9d2754 service nova] Creating event network-changed:0099c8b1-71b7-45a0-abe2-aeecf2e3e73b for instance 4fae3aae-cb67-4c14-b358-59248d99238d on user Apr 19 08:00:28 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-d1c15b08-2e66-458f-82fe-b4b17dcf9c48 req-593ddbee-3679-4795-85d8-f9712e9d2754 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036876 Apr 19 08:00:28 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 28/87] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:00:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:28 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-28b52942-c11e-4788-a2a9-5ac8b2217481 req-4decc83b-0e25-47fe-b0b0-edd6d6a7764f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47562492-07e0-43cb-979a-fd904c3bcf6c", "name": "network-vif-plugged", "status": "completed", "tag": "9aaae4fb-7881-479b-a7a4-10d4d96a3aff"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:28 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=6 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:00:28 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-28b52942-c11e-4788-a2a9-5ac8b2217481 req-4decc83b-0e25-47fe-b0b0-edd6d6a7764f service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:28 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-28b52942-c11e-4788-a2a9-5ac8b2217481 req-4decc83b-0e25-47fe-b0b0-edd6d6a7764f service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:28 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-28b52942-c11e-4788-a2a9-5ac8b2217481 req-4decc83b-0e25-47fe-b0b0-edd6d6a7764f service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:28 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-28b52942-c11e-4788-a2a9-5ac8b2217481 req-4decc83b-0e25-47fe-b0b0-edd6d6a7764f service nova] Creating event network-vif-plugged:9aaae4fb-7881-479b-a7a4-10d4d96a3aff for instance 47562492-07e0-43cb-979a-fd904c3bcf6c on user Apr 19 08:00:28 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-28b52942-c11e-4788-a2a9-5ac8b2217481 req-4decc83b-0e25-47fe-b0b0-edd6d6a7764f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054701 Apr 19 08:00:28 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 30/88] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:00:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 08:00:32 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:00:32 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=10 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:00:32 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-8be6b4f3-2b36-44db-9b40-3219a6de5937 req-68cfa6ec-dba3-49b3-a7be-98267884894e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fae3aae-cb67-4c14-b358-59248d99238d", "name": "network-vif-plugged", "status": "completed", "tag": "0099c8b1-71b7-45a0-abe2-aeecf2e3e73b"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:32 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-8be6b4f3-2b36-44db-9b40-3219a6de5937 req-68cfa6ec-dba3-49b3-a7be-98267884894e service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:32 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-8be6b4f3-2b36-44db-9b40-3219a6de5937 req-68cfa6ec-dba3-49b3-a7be-98267884894e service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:32 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-8be6b4f3-2b36-44db-9b40-3219a6de5937 req-68cfa6ec-dba3-49b3-a7be-98267884894e service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:32 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-8be6b4f3-2b36-44db-9b40-3219a6de5937 req-68cfa6ec-dba3-49b3-a7be-98267884894e service nova] Creating event network-vif-plugged:0099c8b1-71b7-45a0-abe2-aeecf2e3e73b for instance 4fae3aae-cb67-4c14-b358-59248d99238d on user Apr 19 08:00:32 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-8be6b4f3-2b36-44db-9b40-3219a6de5937 req-68cfa6ec-dba3-49b3-a7be-98267884894e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035577 Apr 19 08:00:32 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 31/89] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:00:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:32 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell0:SELECT=8 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:00:32 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-212d22d0-7b26-47c4-a4c8-a4d23835e4fe tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:00:32 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-212d22d0-7b26-47c4-a4c8-a4d23835e4fe tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] [instance: d9311d99-6120-473a-bb42-47a0e6fb78ff] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:00:32 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-212d22d0-7b26-47c4-a4c8-a4d23835e4fe tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:32 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-212d22d0-7b26-47c4-a4c8-a4d23835e4fe tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:32 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-212d22d0-7b26-47c4-a4c8-a4d23835e4fe tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:32 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-212d22d0-7b26-47c4-a4c8-a4d23835e4fe tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:32 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-212d22d0-7b26-47c4-a4c8-a4d23835e4fe tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:32 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-212d22d0-7b26-47c4-a4c8-a4d23835e4fe tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:32 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-212d22d0-7b26-47c4-a4c8-a4d23835e4fe tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee39a220ed4c41d58dc529a568e4e81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be03dec99bf14fe4baa07ed4e4b7d433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:00:32 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-212d22d0-7b26-47c4-a4c8-a4d23835e4fe tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9311d99-6120-473a-bb42-47a0e6fb78ff" status: 200 len: 1491 microversion: 2.1 time: 0.670177 Apr 19 08:00:32 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 29/90] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:00:32 2023] GET /compute/v2.1/servers/d9311d99-6120-473a-bb42-47a0e6fb78ff => generated 1491 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:00:34 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-bacc0832-f3c4-47a9-a599-76cde01262ed tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Action: 'create', calling method: .version_select at 0x7f2c01bc9480>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1575776456", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlNU+RZkQUpT8H2ql1PCNi7lfeX4S0eZFs6UpcRNOM9qMXKDffLU8Qr3d69D2xXSxNtAoNVhxAbrdpC0hTYX0M/jiilTWLCO0mBo0u7ACFt8VR+C1Jf2H9guOVzCnwxMA=="}} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:34 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-bacc0832-f3c4-47a9-a599-76cde01262ed tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Getting quotas for project d5e8362c8d404717b2fa6e510f1de07a. Resources: {'key_pairs'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:00:34 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-bacc0832-f3c4-47a9-a599-76cde01262ed tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Getting quotas for user 3d32cbfb3d854d56ad3961da3f406e77 and project d5e8362c8d404717b2fa6e510f1de07a. Resources: {'key_pairs'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:00:34 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-bacc0832-f3c4-47a9-a599-76cde01262ed tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.164343 Apr 19 08:00:34 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 31/91] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 08:00:34 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:34 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-5f972582-55d5-4c5c-86f9-16d3d97a9f84 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1459682890", "imageRef": "1c4a173b-3d12-4bab-9642-74b37744bc8d", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1575776456", "networks": [{"uuid": "682c6652-a138-4959-89c2-44eddbd9e65c"}]}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:34 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-f65840f7-8993-474c-9446-e2dac72f222d req-a58fbe74-a94d-4844-85cf-01a6ab358253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fae3aae-cb67-4c14-b358-59248d99238d", "name": "network-vif-plugged", "status": "completed", "tag": "0099c8b1-71b7-45a0-abe2-aeecf2e3e73b"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:34 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-f65840f7-8993-474c-9446-e2dac72f222d req-a58fbe74-a94d-4844-85cf-01a6ab358253 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:34 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-f65840f7-8993-474c-9446-e2dac72f222d req-a58fbe74-a94d-4844-85cf-01a6ab358253 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:34 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-f65840f7-8993-474c-9446-e2dac72f222d req-a58fbe74-a94d-4844-85cf-01a6ab358253 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:34 user devstack@n-api.service[61209]: DEBUG nova.network.neutron [None req-5f972582-55d5-4c5c-86f9-16d3d97a9f84 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] validate_networks() for [('682c6652-a138-4959-89c2-44eddbd9e65c', None, None, None, None, None)] {{(pid=61209) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 08:00:34 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-f65840f7-8993-474c-9446-e2dac72f222d req-a58fbe74-a94d-4844-85cf-01a6ab358253 service nova] Creating event network-vif-plugged:0099c8b1-71b7-45a0-abe2-aeecf2e3e73b for instance 4fae3aae-cb67-4c14-b358-59248d99238d on user Apr 19 08:00:34 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-f65840f7-8993-474c-9446-e2dac72f222d req-a58fbe74-a94d-4844-85cf-01a6ab358253 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054813 Apr 19 08:00:34 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 30/92] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:00:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:35 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-5f972582-55d5-4c5c-86f9-16d3d97a9f84 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Flavor limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 08:00:35 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-5f972582-55d5-4c5c-86f9-16d3d97a9f84 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Image limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 08:00:35 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-5f972582-55d5-4c5c-86f9-16d3d97a9f84 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Flavor pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 08:00:35 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-5f972582-55d5-4c5c-86f9-16d3d97a9f84 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Image pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 08:00:35 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-5f972582-55d5-4c5c-86f9-16d3d97a9f84 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 08:00:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5f972582-55d5-4c5c-86f9-16d3d97a9f84 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5f972582-55d5-4c5c-86f9-16d3d97a9f84 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5f972582-55d5-4c5c-86f9-16d3d97a9f84 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5f972582-55d5-4c5c-86f9-16d3d97a9f84 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5f972582-55d5-4c5c-86f9-16d3d97a9f84 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5f972582-55d5-4c5c-86f9-16d3d97a9f84 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:35 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-5f972582-55d5-4c5c-86f9-16d3d97a9f84 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Getting quotas for project d5e8362c8d404717b2fa6e510f1de07a. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:00:35 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-5f972582-55d5-4c5c-86f9-16d3d97a9f84 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Getting quotas for user 3d32cbfb3d854d56ad3961da3f406e77 and project d5e8362c8d404717b2fa6e510f1de07a. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:00:35 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-5f972582-55d5-4c5c-86f9-16d3d97a9f84 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Going to run 1 instances... {{(pid=61209) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 08:00:35 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-5f972582-55d5-4c5c-86f9-16d3d97a9f84 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] [instance: 729daf9c-359b-41f7-a15a-6460beab58c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1c4a173b-3d12-4bab-9642-74b37744bc8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 08:00:35 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-5f972582-55d5-4c5c-86f9-16d3d97a9f84 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.099366 Apr 19 08:00:35 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 32/93] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 08:00:34 2023] POST /compute/v2.1/servers => generated 378 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 08:00:35 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-e65de774-665b-4644-81f9-af2c6775e74c tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:00:35 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-e65de774-665b-4644-81f9-af2c6775e74c tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] [instance: 729daf9c-359b-41f7-a15a-6460beab58c8] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:00:35 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-e65de774-665b-4644-81f9-af2c6775e74c tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32cbfb3d854d56ad3961da3f406e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8362c8d404717b2fa6e510f1de07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:00:35 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-e65de774-665b-4644-81f9-af2c6775e74c tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] 10.0.0.210 "GET /compute/v2.1/servers/729daf9c-359b-41f7-a15a-6460beab58c8" status: 200 len: 1253 microversion: 2.1 time: 0.118973 Apr 19 08:00:35 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 32/94] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:00:35 2023] GET /compute/v2.1/servers/729daf9c-359b-41f7-a15a-6460beab58c8 => generated 1253 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:00:40 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-32a1e898-7537-43e6-befb-ed3783ef81d5 req-d7b3609d-bb7f-48dc-86c9-fe723683737f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "729daf9c-359b-41f7-a15a-6460beab58c8", "tag": "733cba40-6008-4900-8f4f-cd8b0396b3fb"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:40 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-32a1e898-7537-43e6-befb-ed3783ef81d5 req-d7b3609d-bb7f-48dc-86c9-fe723683737f service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:40 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-32a1e898-7537-43e6-befb-ed3783ef81d5 req-d7b3609d-bb7f-48dc-86c9-fe723683737f service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:40 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-32a1e898-7537-43e6-befb-ed3783ef81d5 req-d7b3609d-bb7f-48dc-86c9-fe723683737f service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:40 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-32a1e898-7537-43e6-befb-ed3783ef81d5 req-d7b3609d-bb7f-48dc-86c9-fe723683737f service nova] Creating event network-changed:733cba40-6008-4900-8f4f-cd8b0396b3fb for instance 729daf9c-359b-41f7-a15a-6460beab58c8 on user Apr 19 08:00:40 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-32a1e898-7537-43e6-befb-ed3783ef81d5 req-d7b3609d-bb7f-48dc-86c9-fe723683737f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049115 Apr 19 08:00:40 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 31/95] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:00:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:40 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-c15e34c5-4001-4953-8e00-f0c213b22b11 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:00:40 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-c15e34c5-4001-4953-8e00-f0c213b22b11 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] [instance: a36b83d3-7114-49dc-9632-48c0dacafbf8] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:00:40 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c15e34c5-4001-4953-8e00-f0c213b22b11 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:40 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c15e34c5-4001-4953-8e00-f0c213b22b11 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:40 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c15e34c5-4001-4953-8e00-f0c213b22b11 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:40 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c15e34c5-4001-4953-8e00-f0c213b22b11 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:40 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c15e34c5-4001-4953-8e00-f0c213b22b11 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:40 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c15e34c5-4001-4953-8e00-f0c213b22b11 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:40 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=6 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:00:40 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-c15e34c5-4001-4953-8e00-f0c213b22b11 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9796d2c200d4419b0fe67d541efc8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173f7e00d8f748debe5a126203220f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:00:40 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-c15e34c5-4001-4953-8e00-f0c213b22b11 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a36b83d3-7114-49dc-9632-48c0dacafbf8" status: 200 len: 1504 microversion: 2.1 time: 0.470153 Apr 19 08:00:40 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 33/96] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:00:40 2023] GET /compute/v2.1/servers/a36b83d3-7114-49dc-9632-48c0dacafbf8 => generated 1504 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:00:40 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-9cbc8388-2fef-446b-b302-d0987aee8add tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Action: 'create', calling method: .version_select at 0x7f2c01bc9870>, body: {"keypair": {"name": "tempest-keypair-1494237566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAV5PPaoQPdSnKCerN1S9h5jYbndpipKKqzy6s+rkWXNyCje9Yi3IQ3VaWHzVjmgTQROmob27G1YI3fRS3D1mkLXMEV15IssDTpu2yUPJLnTanwXjbeGguBCRmgJ/sBRRw=="}} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:40 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-9cbc8388-2fef-446b-b302-d0987aee8add tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Getting quotas for project 8d73100ea55541d08952a24ef6931a0a. Resources: {'key_pairs'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:00:40 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-9cbc8388-2fef-446b-b302-d0987aee8add tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Getting quotas for user 64f18935b0524876bf69f22cff03139a and project 8d73100ea55541d08952a24ef6931a0a. Resources: {'key_pairs'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:00:40 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-9cbc8388-2fef-446b-b302-d0987aee8add tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.328898 Apr 19 08:00:40 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 33/97] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 08:00:40 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:42 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-4f629273-dad9-42ae-be90-94b182923f1d tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Action: 'create', calling method: .version_select at 0x7f2c01bdb250>, body: {"keypair": {"name": "tempest-keypair-1127111588", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjXahJx9irrgAhvFFGuoHo8iY7jdugLzXwtBZX5Q6rJL23XXSTaxC1Ql3kHLM/+R2p05+RVGx+EFCeILJ8HwSoB7g6Uu7gNNim8ourCOG/QJ5pJ+0fViv7oHPhV0xfdPA=="}} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:42 user devstack@n-api.service[61210]: DEBUG nova.quota [None req-4f629273-dad9-42ae-be90-94b182923f1d tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Getting quotas for project ebcde8c2a3444e919d232ea854c00e6f. Resources: {'key_pairs'} {{(pid=61210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:00:42 user devstack@n-api.service[61210]: DEBUG nova.quota [None req-4f629273-dad9-42ae-be90-94b182923f1d tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Getting quotas for user 16dc2a88f2d149a1a4035ed1c7e74b45 and project ebcde8c2a3444e919d232ea854c00e6f. Resources: {'key_pairs'} {{(pid=61210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:00:42 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-4f629273-dad9-42ae-be90-94b182923f1d tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.315907 Apr 19 08:00:42 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 32/98] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 08:00:42 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:43 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-4ebf595f-851a-483c-be0b-85d518497fc9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1168824159", "imageRef": "b515545f-3b22-4d80-a102-6a318ab9717a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ecb38694-e852-4967-af2b-2b034921cae2"}], "security_groups": [{"name": "tempest-securitygroup--2115240419"}], "key_name": "tempest-keypair-1494237566", "user_data": "}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:43 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=7 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:00:43 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-bccd993f-6a5a-478a-8e22-f7e4ee291a3a req-b4c7181a-695a-487f-b3c8-f9dcb970bcd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "729daf9c-359b-41f7-a15a-6460beab58c8", "name": "network-vif-plugged", "status": "completed", "tag": "733cba40-6008-4900-8f4f-cd8b0396b3fb"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:43 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-bccd993f-6a5a-478a-8e22-f7e4ee291a3a req-b4c7181a-695a-487f-b3c8-f9dcb970bcd1 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:43 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-bccd993f-6a5a-478a-8e22-f7e4ee291a3a req-b4c7181a-695a-487f-b3c8-f9dcb970bcd1 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:43 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-bccd993f-6a5a-478a-8e22-f7e4ee291a3a req-b4c7181a-695a-487f-b3c8-f9dcb970bcd1 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:43 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-bccd993f-6a5a-478a-8e22-f7e4ee291a3a req-b4c7181a-695a-487f-b3c8-f9dcb970bcd1 service nova] Creating event network-vif-plugged:733cba40-6008-4900-8f4f-cd8b0396b3fb for instance 729daf9c-359b-41f7-a15a-6460beab58c8 on user Apr 19 08:00:43 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-bccd993f-6a5a-478a-8e22-f7e4ee291a3a req-b4c7181a-695a-487f-b3c8-f9dcb970bcd1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031591 Apr 19 08:00:43 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 34/99] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:00:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:43 user devstack@n-api.service[61209]: DEBUG nova.network.neutron [None req-4ebf595f-851a-483c-be0b-85d518497fc9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] validate_networks() for [('ecb38694-e852-4967-af2b-2b034921cae2', None, None, None, None, None)] {{(pid=61209) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 08:00:43 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-4ebf595f-851a-483c-be0b-85d518497fc9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Flavor limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 08:00:43 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-4ebf595f-851a-483c-be0b-85d518497fc9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Image limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 08:00:43 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-4ebf595f-851a-483c-be0b-85d518497fc9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Flavor pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 08:00:43 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-4ebf595f-851a-483c-be0b-85d518497fc9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Image pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 08:00:43 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-4ebf595f-851a-483c-be0b-85d518497fc9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 08:00:43 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-4ebf595f-851a-483c-be0b-85d518497fc9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:43 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-4ebf595f-851a-483c-be0b-85d518497fc9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:43 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-4ebf595f-851a-483c-be0b-85d518497fc9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:43 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-4ebf595f-851a-483c-be0b-85d518497fc9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:43 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-4ebf595f-851a-483c-be0b-85d518497fc9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:43 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-4ebf595f-851a-483c-be0b-85d518497fc9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:43 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-4ebf595f-851a-483c-be0b-85d518497fc9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Getting quotas for project 8d73100ea55541d08952a24ef6931a0a. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:00:43 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-4ebf595f-851a-483c-be0b-85d518497fc9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Getting quotas for user 64f18935b0524876bf69f22cff03139a and project 8d73100ea55541d08952a24ef6931a0a. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:00:43 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-4ebf595f-851a-483c-be0b-85d518497fc9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Going to run 1 instances... {{(pid=61209) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 08:00:43 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-4ebf595f-851a-483c-be0b-85d518497fc9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] [instance: 5eb02260-a7ea-4b05-8d8d-72950cfce57b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b515545f-3b22-4d80-a102-6a318ab9717a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 08:00:43 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-4ebf595f-851a-483c-be0b-85d518497fc9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.882679 Apr 19 08:00:43 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 34/100] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 08:00:43 2023] POST /compute/v2.1/servers => generated 400 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 08:00:43 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-7bce2f1a-8d0e-4d53-ae60-22834aeaa835 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:00:43 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-7bce2f1a-8d0e-4d53-ae60-22834aeaa835 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] [instance: 5eb02260-a7ea-4b05-8d8d-72950cfce57b] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:00:43 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=4 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:00:44 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-7bce2f1a-8d0e-4d53-ae60-22834aeaa835 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f18935b0524876bf69f22cff03139a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d73100ea55541d08952a24ef6931a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:00:44 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-7bce2f1a-8d0e-4d53-ae60-22834aeaa835 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5eb02260-a7ea-4b05-8d8d-72950cfce57b" status: 200 len: 1232 microversion: 2.1 time: 0.113889 Apr 19 08:00:44 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 33/101] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:00:43 2023] GET /compute/v2.1/servers/5eb02260-a7ea-4b05-8d8d-72950cfce57b => generated 1232 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:00:44 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-d7f98977-37bb-4e27-9438-a98004999b9b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-759425170", "imageRef": "b515545f-3b22-4d80-a102-6a318ab9717a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "64c5035e-02a5-4732-87aa-9af0eb7f1434"}], "security_groups": [{"name": "tempest-securitygroup--1445977716"}], "key_name": "tempest-keypair-1127111588", "user_data": "}} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:44 user devstack@n-api.service[61208]: DEBUG nova.network.neutron [None req-d7f98977-37bb-4e27-9438-a98004999b9b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] validate_networks() for [('64c5035e-02a5-4732-87aa-9af0eb7f1434', None, None, None, None, None)] {{(pid=61208) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 08:00:44 user devstack@n-api.service[61208]: DEBUG nova.virt.hardware [None req-d7f98977-37bb-4e27-9438-a98004999b9b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Flavor limits 0:0:0 {{(pid=61208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 08:00:44 user devstack@n-api.service[61208]: DEBUG nova.virt.hardware [None req-d7f98977-37bb-4e27-9438-a98004999b9b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Image limits 0:0:0 {{(pid=61208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 08:00:44 user devstack@n-api.service[61208]: DEBUG nova.virt.hardware [None req-d7f98977-37bb-4e27-9438-a98004999b9b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Flavor pref 0:0:0 {{(pid=61208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 08:00:44 user devstack@n-api.service[61208]: DEBUG nova.virt.hardware [None req-d7f98977-37bb-4e27-9438-a98004999b9b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Image pref 0:0:0 {{(pid=61208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 08:00:44 user devstack@n-api.service[61208]: DEBUG nova.virt.hardware [None req-d7f98977-37bb-4e27-9438-a98004999b9b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 08:00:44 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-d7f98977-37bb-4e27-9438-a98004999b9b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:44 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-d7f98977-37bb-4e27-9438-a98004999b9b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:44 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-d7f98977-37bb-4e27-9438-a98004999b9b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:44 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-d7f98977-37bb-4e27-9438-a98004999b9b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:44 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-d7f98977-37bb-4e27-9438-a98004999b9b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:44 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-d7f98977-37bb-4e27-9438-a98004999b9b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:44 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-d7f98977-37bb-4e27-9438-a98004999b9b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Getting quotas for project ebcde8c2a3444e919d232ea854c00e6f. Resources: {'ram', 'cores', 'instances'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:00:44 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-d7f98977-37bb-4e27-9438-a98004999b9b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Getting quotas for user 16dc2a88f2d149a1a4035ed1c7e74b45 and project ebcde8c2a3444e919d232ea854c00e6f. Resources: {'ram', 'cores', 'instances'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:00:44 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-d7f98977-37bb-4e27-9438-a98004999b9b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Going to run 1 instances... {{(pid=61208) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 08:00:44 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-d7f98977-37bb-4e27-9438-a98004999b9b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] [instance: bdeeb437-76a3-49b5-9553-d2da74917d69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b515545f-3b22-4d80-a102-6a318ab9717a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61208) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 08:00:44 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-d7f98977-37bb-4e27-9438-a98004999b9b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.689360 Apr 19 08:00:44 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 35/102] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 08:00:44 2023] POST /compute/v2.1/servers => generated 407 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 08:00:44 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-39c6d565-73fd-4419-b9d9-8d5298b6e04d tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:00:44 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-39c6d565-73fd-4419-b9d9-8d5298b6e04d tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] [instance: bdeeb437-76a3-49b5-9553-d2da74917d69] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:00:44 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-39c6d565-73fd-4419-b9d9-8d5298b6e04d tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dc2a88f2d149a1a4035ed1c7e74b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcde8c2a3444e919d232ea854c00e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:00:44 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-39c6d565-73fd-4419-b9d9-8d5298b6e04d tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69" status: 200 len: 1232 microversion: 2.1 time: 0.059992 Apr 19 08:00:44 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 34/103] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:00:44 2023] GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69 => generated 1232 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:00:45 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-1609fc84-1c7c-4ceb-bc34-45702f429921 tempest-TestStampPattern-469082723 tempest-TestStampPattern-469082723-project-member] Action: 'create', calling method: .version_select at 0x7f2c01288dc0>, body: {"keypair": {"name": "tempest-TestStampPattern-48855945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKfUFnk/w3y8xOJuS3Vzs5eXzB8WoRs1P2teop/0wipzZ0o/C4pyRzBL5plX452H5OTS6hJmpkwZGJLYZIl6yritGI6ZRavWZZ6VICcsuIK8Q4Cp5q0b5nohLAvROoamg=="}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:45 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-1609fc84-1c7c-4ceb-bc34-45702f429921 tempest-TestStampPattern-469082723 tempest-TestStampPattern-469082723-project-member] Getting quotas for project 126aafd42e244fe9a67a7f895373f529. Resources: {'key_pairs'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:00:45 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-1609fc84-1c7c-4ceb-bc34-45702f429921 tempest-TestStampPattern-469082723 tempest-TestStampPattern-469082723-project-member] Getting quotas for user f381319b120b4944972d86a94bf9ec74 and project 126aafd42e244fe9a67a7f895373f529. Resources: {'key_pairs'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:00:45 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-1609fc84-1c7c-4ceb-bc34-45702f429921 tempest-TestStampPattern-469082723 tempest-TestStampPattern-469082723-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 393 microversion: 2.1 time: 0.282679 Apr 19 08:00:45 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 35/104] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 08:00:44 2023] POST /compute/v2.1/os-keypairs => generated 393 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:45 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-83228c1a-b2b6-47d3-b460-d0e5711b8ec3 req-48436575-c42e-48d6-a2a6-2ef9669e111a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "729daf9c-359b-41f7-a15a-6460beab58c8", "name": "network-vif-plugged", "status": "completed", "tag": "733cba40-6008-4900-8f4f-cd8b0396b3fb"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:45 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-83228c1a-b2b6-47d3-b460-d0e5711b8ec3 req-48436575-c42e-48d6-a2a6-2ef9669e111a service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:45 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-83228c1a-b2b6-47d3-b460-d0e5711b8ec3 req-48436575-c42e-48d6-a2a6-2ef9669e111a service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:45 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-83228c1a-b2b6-47d3-b460-d0e5711b8ec3 req-48436575-c42e-48d6-a2a6-2ef9669e111a service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:45 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-83228c1a-b2b6-47d3-b460-d0e5711b8ec3 req-48436575-c42e-48d6-a2a6-2ef9669e111a service nova] Creating event network-vif-plugged:733cba40-6008-4900-8f4f-cd8b0396b3fb for instance 729daf9c-359b-41f7-a15a-6460beab58c8 on user Apr 19 08:00:45 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-83228c1a-b2b6-47d3-b460-d0e5711b8ec3 req-48436575-c42e-48d6-a2a6-2ef9669e111a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033019 Apr 19 08:00:45 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 36/105] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:00:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:48 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-b7ff0c28-91a0-48f7-8979-742c88e63a1c req-ee6a00d8-d187-4677-b66d-3f4d11af4089 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eb02260-a7ea-4b05-8d8d-72950cfce57b", "tag": "dde1193b-2522-4f45-9742-39f340a3f35f"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:48 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-b7ff0c28-91a0-48f7-8979-742c88e63a1c req-ee6a00d8-d187-4677-b66d-3f4d11af4089 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:48 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-b7ff0c28-91a0-48f7-8979-742c88e63a1c req-ee6a00d8-d187-4677-b66d-3f4d11af4089 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:48 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-b7ff0c28-91a0-48f7-8979-742c88e63a1c req-ee6a00d8-d187-4677-b66d-3f4d11af4089 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:48 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-b7ff0c28-91a0-48f7-8979-742c88e63a1c req-ee6a00d8-d187-4677-b66d-3f4d11af4089 service nova] Creating event network-changed:dde1193b-2522-4f45-9742-39f340a3f35f for instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b on user Apr 19 08:00:48 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-b7ff0c28-91a0-48f7-8979-742c88e63a1c req-ee6a00d8-d187-4677-b66d-3f4d11af4089 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037601 Apr 19 08:00:48 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 35/106] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:00:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:48 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-967d2120-c5d5-4c95-a5b9-f4cf1e21311d tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:00:48 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-967d2120-c5d5-4c95-a5b9-f4cf1e21311d tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] [instance: 396bea78-4da8-4d59-b595-4617e997a3a0] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:00:48 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-967d2120-c5d5-4c95-a5b9-f4cf1e21311d tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:49 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-967d2120-c5d5-4c95-a5b9-f4cf1e21311d tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:49 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-967d2120-c5d5-4c95-a5b9-f4cf1e21311d tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:49 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-967d2120-c5d5-4c95-a5b9-f4cf1e21311d tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:49 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-967d2120-c5d5-4c95-a5b9-f4cf1e21311d tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:49 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-967d2120-c5d5-4c95-a5b9-f4cf1e21311d tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:49 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-967d2120-c5d5-4c95-a5b9-f4cf1e21311d tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519a9c3c2f6e4c01a0115f12885554ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22007f1c0da74c8aa2bfea0a0d1e1b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:00:49 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-ec1607d5-d292-4ab2-baa8-feefc209cd29 tempest-TestStampPattern-469082723 tempest-TestStampPattern-469082723-project-member] Calling method '.version_select at 0x7f2c01bcbeb0>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:00:49 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-967d2120-c5d5-4c95-a5b9-f4cf1e21311d tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] 10.0.0.210 "GET /compute/v2.1/servers/396bea78-4da8-4d59-b595-4617e997a3a0" status: 200 len: 1552 microversion: 2.1 time: 0.314737 Apr 19 08:00:49 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 36/107] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:00:48 2023] GET /compute/v2.1/servers/396bea78-4da8-4d59-b595-4617e997a3a0 => generated 1552 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:00:49 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=5 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:00:49 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-ec1607d5-d292-4ab2-baa8-feefc209cd29 tempest-TestStampPattern-469082723 tempest-TestStampPattern-469082723-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-48855945" status: 202 len: 0 microversion: 2.1 time: 0.029911 Apr 19 08:00:49 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 37/108] 10.0.0.210 () {62 vars in 1319 bytes} [Wed Apr 19 08:00:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-48855945 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 08:00:49 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-87b15bb9-7c8b-449e-a439-96f48ac39304 req-ee264f80-da5f-431a-8e32-7eb177dc996b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdeeb437-76a3-49b5-9553-d2da74917d69", "tag": "8cebef39-d819-436e-9047-40d02c752d9e"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:49 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-87b15bb9-7c8b-449e-a439-96f48ac39304 req-ee264f80-da5f-431a-8e32-7eb177dc996b service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:49 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-87b15bb9-7c8b-449e-a439-96f48ac39304 req-ee264f80-da5f-431a-8e32-7eb177dc996b service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:49 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-87b15bb9-7c8b-449e-a439-96f48ac39304 req-ee264f80-da5f-431a-8e32-7eb177dc996b service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:49 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-87b15bb9-7c8b-449e-a439-96f48ac39304 req-ee264f80-da5f-431a-8e32-7eb177dc996b service nova] Creating event network-changed:8cebef39-d819-436e-9047-40d02c752d9e for instance bdeeb437-76a3-49b5-9553-d2da74917d69 on user Apr 19 08:00:49 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-87b15bb9-7c8b-449e-a439-96f48ac39304 req-ee264f80-da5f-431a-8e32-7eb177dc996b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041420 Apr 19 08:00:49 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 36/109] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:00:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:52 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-13152dc2-ee2a-46ca-9664-20ada86e7ba8 req-daa82d4c-f364-400f-8820-d6782ef10cba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb02260-a7ea-4b05-8d8d-72950cfce57b", "name": "network-vif-plugged", "status": "completed", "tag": "dde1193b-2522-4f45-9742-39f340a3f35f"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:52 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-13152dc2-ee2a-46ca-9664-20ada86e7ba8 req-daa82d4c-f364-400f-8820-d6782ef10cba service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:52 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-13152dc2-ee2a-46ca-9664-20ada86e7ba8 req-daa82d4c-f364-400f-8820-d6782ef10cba service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:52 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-13152dc2-ee2a-46ca-9664-20ada86e7ba8 req-daa82d4c-f364-400f-8820-d6782ef10cba service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:52 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-13152dc2-ee2a-46ca-9664-20ada86e7ba8 req-daa82d4c-f364-400f-8820-d6782ef10cba service nova] Creating event network-vif-plugged:dde1193b-2522-4f45-9742-39f340a3f35f for instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b on user Apr 19 08:00:52 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-13152dc2-ee2a-46ca-9664-20ada86e7ba8 req-daa82d4c-f364-400f-8820-d6782ef10cba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218730 Apr 19 08:00:52 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 37/110] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:00:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:00:54 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-9f08d6b9-18fd-40e1-b343-2154745e6e1b req-92de9889-9c05-4b05-a005-b3be6ed7deb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb02260-a7ea-4b05-8d8d-72950cfce57b", "name": "network-vif-plugged", "status": "completed", "tag": "dde1193b-2522-4f45-9742-39f340a3f35f"}, {"server_uuid": "bdeeb437-76a3-49b5-9553-d2da74917d69", "name": "network-vif-plugged", "status": "completed", "tag": "8cebef39-d819-436e-9047-40d02c752d9e"}, {"server_uuid": "bdeeb437-76a3-49b5-9553-d2da74917d69", "name": "network-vif-plugged", "status": "completed", "tag": "8cebef39-d819-436e-9047-40d02c752d9e"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:00:54 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-9f08d6b9-18fd-40e1-b343-2154745e6e1b req-92de9889-9c05-4b05-a005-b3be6ed7deb0 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:00:54 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-9f08d6b9-18fd-40e1-b343-2154745e6e1b req-92de9889-9c05-4b05-a005-b3be6ed7deb0 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:00:54 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-9f08d6b9-18fd-40e1-b343-2154745e6e1b req-92de9889-9c05-4b05-a005-b3be6ed7deb0 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:00:54 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-9f08d6b9-18fd-40e1-b343-2154745e6e1b req-92de9889-9c05-4b05-a005-b3be6ed7deb0 service nova] Creating event network-vif-plugged:dde1193b-2522-4f45-9742-39f340a3f35f for instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b on user Apr 19 08:00:54 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-9f08d6b9-18fd-40e1-b343-2154745e6e1b req-92de9889-9c05-4b05-a005-b3be6ed7deb0 service nova] Creating event network-vif-plugged:8cebef39-d819-436e-9047-40d02c752d9e for instance bdeeb437-76a3-49b5-9553-d2da74917d69 on user Apr 19 08:00:54 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-9f08d6b9-18fd-40e1-b343-2154745e6e1b req-92de9889-9c05-4b05-a005-b3be6ed7deb0 service nova] Creating event network-vif-plugged:8cebef39-d819-436e-9047-40d02c752d9e for instance bdeeb437-76a3-49b5-9553-d2da74917d69 on user Apr 19 08:00:54 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-9f08d6b9-18fd-40e1-b343-2154745e6e1b req-92de9889-9c05-4b05-a005-b3be6ed7deb0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.067060 Apr 19 08:00:54 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 38/111] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:00:54 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:01:06 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell0:SELECT=8 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:01:06 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=11 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:01:06 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=16 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:01:06 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-6bd45228-720d-430e-a080-86a55a473b43 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:01:06 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-6bd45228-720d-430e-a080-86a55a473b43 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] [instance: 47562492-07e0-43cb-979a-fd904c3bcf6c] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:01:06 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6bd45228-720d-430e-a080-86a55a473b43 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:06 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6bd45228-720d-430e-a080-86a55a473b43 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:06 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6bd45228-720d-430e-a080-86a55a473b43 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:06 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6bd45228-720d-430e-a080-86a55a473b43 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:06 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6bd45228-720d-430e-a080-86a55a473b43 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:06 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6bd45228-720d-430e-a080-86a55a473b43 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:06 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-6bd45228-720d-430e-a080-86a55a473b43 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b62de8ca3994e54ae9c9cd891a8f4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616eae3faffb4aaa9fbdae47ea8d5cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:01:06 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-6bd45228-720d-430e-a080-86a55a473b43 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47562492-07e0-43cb-979a-fd904c3bcf6c" status: 200 len: 1548 microversion: 2.1 time: 0.230596 Apr 19 08:01:06 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 37/112] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:01:06 2023] GET /compute/v2.1/servers/47562492-07e0-43cb-979a-fd904c3bcf6c => generated 1548 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:01:11 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=4 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:01:11 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=16 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:01:11 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=4 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:01:11 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=21 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:01:11 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-54d7dca8-0108-4932-ab9d-672f8d7c55ed tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:01:11 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-54d7dca8-0108-4932-ab9d-672f8d7c55ed tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] [instance: 4fae3aae-cb67-4c14-b358-59248d99238d] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:01:11 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-54d7dca8-0108-4932-ab9d-672f8d7c55ed tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:11 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-54d7dca8-0108-4932-ab9d-672f8d7c55ed tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:11 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-54d7dca8-0108-4932-ab9d-672f8d7c55ed tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:11 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-54d7dca8-0108-4932-ab9d-672f8d7c55ed tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:11 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-54d7dca8-0108-4932-ab9d-672f8d7c55ed tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:11 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-54d7dca8-0108-4932-ab9d-672f8d7c55ed tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:11 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-54d7dca8-0108-4932-ab9d-672f8d7c55ed tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef0fdb3c84ba9948b0806fd74f279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463fd5763cb24abeae209399cb8ff073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:01:11 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-54d7dca8-0108-4932-ab9d-672f8d7c55ed tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fae3aae-cb67-4c14-b358-59248d99238d" status: 200 len: 1545 microversion: 2.1 time: 0.259941 Apr 19 08:01:11 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 38/113] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:01:11 2023] GET /compute/v2.1/servers/4fae3aae-cb67-4c14-b358-59248d99238d => generated 1545 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:01:25 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:01:25 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=16 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:01:25 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:01:25 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=8 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:01:25 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-2abde12d-1000-495c-a7bc-2a2d8a21159e tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:01:25 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-2abde12d-1000-495c-a7bc-2a2d8a21159e tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] [instance: 729daf9c-359b-41f7-a15a-6460beab58c8] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:01:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-2abde12d-1000-495c-a7bc-2a2d8a21159e tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-2abde12d-1000-495c-a7bc-2a2d8a21159e tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-2abde12d-1000-495c-a7bc-2a2d8a21159e tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-2abde12d-1000-495c-a7bc-2a2d8a21159e tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-2abde12d-1000-495c-a7bc-2a2d8a21159e tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-2abde12d-1000-495c-a7bc-2a2d8a21159e tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:26 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-2abde12d-1000-495c-a7bc-2a2d8a21159e tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32cbfb3d854d56ad3961da3f406e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8362c8d404717b2fa6e510f1de07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:01:26 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-2abde12d-1000-495c-a7bc-2a2d8a21159e tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] 10.0.0.210 "GET /compute/v2.1/servers/729daf9c-359b-41f7-a15a-6460beab58c8" status: 200 len: 1537 microversion: 2.1 time: 0.435813 Apr 19 08:01:26 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 39/114] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:01:25 2023] GET /compute/v2.1/servers/729daf9c-359b-41f7-a15a-6460beab58c8 => generated 1537 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:01:34 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=2 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:01:34 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=6 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:01:34 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-0264fef0-a6b8-4c4a-8c3f-15b73a7b9aaa tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:01:34 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-0264fef0-a6b8-4c4a-8c3f-15b73a7b9aaa tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] [instance: 5eb02260-a7ea-4b05-8d8d-72950cfce57b] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:01:34 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-0264fef0-a6b8-4c4a-8c3f-15b73a7b9aaa tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:34 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-0264fef0-a6b8-4c4a-8c3f-15b73a7b9aaa tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:34 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-0264fef0-a6b8-4c4a-8c3f-15b73a7b9aaa tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:34 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-0264fef0-a6b8-4c4a-8c3f-15b73a7b9aaa tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:34 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-0264fef0-a6b8-4c4a-8c3f-15b73a7b9aaa tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:34 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-0264fef0-a6b8-4c4a-8c3f-15b73a7b9aaa tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:34 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-0264fef0-a6b8-4c4a-8c3f-15b73a7b9aaa tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f18935b0524876bf69f22cff03139a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d73100ea55541d08952a24ef6931a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:01:34 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-0264fef0-a6b8-4c4a-8c3f-15b73a7b9aaa tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5eb02260-a7ea-4b05-8d8d-72950cfce57b" status: 200 len: 1538 microversion: 2.1 time: 0.243186 Apr 19 08:01:34 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 38/115] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:01:34 2023] GET /compute/v2.1/servers/5eb02260-a7ea-4b05-8d8d-72950cfce57b => generated 1538 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:01:34 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-087955fb-6fc0-4515-a146-ba949668372c tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:01:34 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-087955fb-6fc0-4515-a146-ba949668372c tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] [instance: d9311d99-6120-473a-bb42-47a0e6fb78ff] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:01:34 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:01:34 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=6 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:01:34 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-087955fb-6fc0-4515-a146-ba949668372c tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:34 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-087955fb-6fc0-4515-a146-ba949668372c tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:34 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-087955fb-6fc0-4515-a146-ba949668372c tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:34 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-087955fb-6fc0-4515-a146-ba949668372c tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:34 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-087955fb-6fc0-4515-a146-ba949668372c tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:34 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-087955fb-6fc0-4515-a146-ba949668372c tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:34 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-087955fb-6fc0-4515-a146-ba949668372c tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] [instance: d9311d99-6120-473a-bb42-47a0e6fb78ff] Going to try to terminate instance {{(pid=61209) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:01:34 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-087955fb-6fc0-4515-a146-ba949668372c tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d9311d99-6120-473a-bb42-47a0e6fb78ff" status: 204 len: 0 microversion: 2.1 time: 0.158498 Apr 19 08:01:34 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 39/116] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:01:34 2023] DELETE /compute/v2.1/servers/d9311d99-6120-473a-bb42-47a0e6fb78ff => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 08:01:34 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-0182d208-69e6-4515-857e-3b140331dddc tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:01:34 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-0182d208-69e6-4515-857e-3b140331dddc tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] [instance: d9311d99-6120-473a-bb42-47a0e6fb78ff] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:01:34 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-0182d208-69e6-4515-857e-3b140331dddc tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:34 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-0182d208-69e6-4515-857e-3b140331dddc tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:34 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-0182d208-69e6-4515-857e-3b140331dddc tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:34 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-0182d208-69e6-4515-857e-3b140331dddc tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:34 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-0182d208-69e6-4515-857e-3b140331dddc tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:34 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-0182d208-69e6-4515-857e-3b140331dddc tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:35 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-0182d208-69e6-4515-857e-3b140331dddc tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee39a220ed4c41d58dc529a568e4e81a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be03dec99bf14fe4baa07ed4e4b7d433', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:01:35 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-0182d208-69e6-4515-857e-3b140331dddc tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9311d99-6120-473a-bb42-47a0e6fb78ff" status: 200 len: 1497 microversion: 2.1 time: 0.340523 Apr 19 08:01:35 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 40/117] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:01:34 2023] GET /compute/v2.1/servers/d9311d99-6120-473a-bb42-47a0e6fb78ff => generated 1497 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:01:35 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-06e762d0-0e6e-4e38-827a-e514aa5031a1 req-b8453471-b164-4c74-a836-bd06e9acdeea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9311d99-6120-473a-bb42-47a0e6fb78ff", "name": "network-vif-unplugged", "status": "completed", "tag": "459b47f8-a672-4fc3-9e57-e10f0cd305fa"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:01:35 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-ac9e8d70-34cf-4167-a7df-9f5e80c7bfb0 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:01:35 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-ac9e8d70-34cf-4167-a7df-9f5e80c7bfb0 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] [instance: bdeeb437-76a3-49b5-9553-d2da74917d69] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:01:35 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-06e762d0-0e6e-4e38-827a-e514aa5031a1 req-b8453471-b164-4c74-a836-bd06e9acdeea service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:35 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-06e762d0-0e6e-4e38-827a-e514aa5031a1 req-b8453471-b164-4c74-a836-bd06e9acdeea service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:35 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-06e762d0-0e6e-4e38-827a-e514aa5031a1 req-b8453471-b164-4c74-a836-bd06e9acdeea service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-ac9e8d70-34cf-4167-a7df-9f5e80c7bfb0 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-ac9e8d70-34cf-4167-a7df-9f5e80c7bfb0 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-ac9e8d70-34cf-4167-a7df-9f5e80c7bfb0 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-ac9e8d70-34cf-4167-a7df-9f5e80c7bfb0 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-ac9e8d70-34cf-4167-a7df-9f5e80c7bfb0 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-ac9e8d70-34cf-4167-a7df-9f5e80c7bfb0 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:35 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-06e762d0-0e6e-4e38-827a-e514aa5031a1 req-b8453471-b164-4c74-a836-bd06e9acdeea service nova] Creating event network-vif-unplugged:459b47f8-a672-4fc3-9e57-e10f0cd305fa for instance d9311d99-6120-473a-bb42-47a0e6fb78ff on user Apr 19 08:01:35 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-06e762d0-0e6e-4e38-827a-e514aa5031a1 req-b8453471-b164-4c74-a836-bd06e9acdeea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053861 Apr 19 08:01:35 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 39/118] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:01:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:01:35 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-ac9e8d70-34cf-4167-a7df-9f5e80c7bfb0 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dc2a88f2d149a1a4035ed1c7e74b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcde8c2a3444e919d232ea854c00e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:01:35 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-ac9e8d70-34cf-4167-a7df-9f5e80c7bfb0 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69" status: 200 len: 1539 microversion: 2.1 time: 0.482192 Apr 19 08:01:35 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 40/119] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:01:35 2023] GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69 => generated 1539 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:01:35 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-67eeb349-1919-4288-be83-bf74e867e4ee req-f055f86b-258e-40a1-b76d-43f5bd79684e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9311d99-6120-473a-bb42-47a0e6fb78ff", "name": "network-vif-deleted", "tag": "459b47f8-a672-4fc3-9e57-e10f0cd305fa"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:01:35 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-67eeb349-1919-4288-be83-bf74e867e4ee req-f055f86b-258e-40a1-b76d-43f5bd79684e service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:35 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-67eeb349-1919-4288-be83-bf74e867e4ee req-f055f86b-258e-40a1-b76d-43f5bd79684e service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:35 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-67eeb349-1919-4288-be83-bf74e867e4ee req-f055f86b-258e-40a1-b76d-43f5bd79684e service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:36 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-67eeb349-1919-4288-be83-bf74e867e4ee req-f055f86b-258e-40a1-b76d-43f5bd79684e service nova] Creating event network-vif-deleted:459b47f8-a672-4fc3-9e57-e10f0cd305fa for instance d9311d99-6120-473a-bb42-47a0e6fb78ff on user Apr 19 08:01:36 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-67eeb349-1919-4288-be83-bf74e867e4ee req-f055f86b-258e-40a1-b76d-43f5bd79684e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038369 Apr 19 08:01:36 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 41/120] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:01:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 08:01:37 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-f2b1f337-19ed-44bf-93b9-1436153fbda3 req-cee96d50-8dba-4fd8-9864-9195a0563821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9311d99-6120-473a-bb42-47a0e6fb78ff", "name": "network-vif-plugged", "status": "completed", "tag": "459b47f8-a672-4fc3-9e57-e10f0cd305fa"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:01:37 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-f2b1f337-19ed-44bf-93b9-1436153fbda3 req-cee96d50-8dba-4fd8-9864-9195a0563821 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:37 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-f2b1f337-19ed-44bf-93b9-1436153fbda3 req-cee96d50-8dba-4fd8-9864-9195a0563821 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:37 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-f2b1f337-19ed-44bf-93b9-1436153fbda3 req-cee96d50-8dba-4fd8-9864-9195a0563821 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:37 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-f2b1f337-19ed-44bf-93b9-1436153fbda3 req-cee96d50-8dba-4fd8-9864-9195a0563821 service nova] Creating event network-vif-plugged:459b47f8-a672-4fc3-9e57-e10f0cd305fa for instance d9311d99-6120-473a-bb42-47a0e6fb78ff on user Apr 19 08:01:37 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-f2b1f337-19ed-44bf-93b9-1436153fbda3 req-cee96d50-8dba-4fd8-9864-9195a0563821 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027558 Apr 19 08:01:37 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 40/121] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:01:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:01:40 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-bc1af2f3-21c1-46f4-9440-e24f43b2f56f tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:01:40 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-bc1af2f3-21c1-46f4-9440-e24f43b2f56f tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] [instance: a36b83d3-7114-49dc-9632-48c0dacafbf8] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:01:40 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-bc1af2f3-21c1-46f4-9440-e24f43b2f56f tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:40 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-bc1af2f3-21c1-46f4-9440-e24f43b2f56f tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:40 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-bc1af2f3-21c1-46f4-9440-e24f43b2f56f tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:40 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-bc1af2f3-21c1-46f4-9440-e24f43b2f56f tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:40 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-bc1af2f3-21c1-46f4-9440-e24f43b2f56f tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:40 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-bc1af2f3-21c1-46f4-9440-e24f43b2f56f tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:40 user devstack@n-api.service[61209]: DEBUG nova.objects.instance [None req-bc1af2f3-21c1-46f4-9440-e24f43b2f56f tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lazy-loading 'flavor' on Instance uuid a36b83d3-7114-49dc-9632-48c0dacafbf8 {{(pid=61209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 19 08:01:40 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-bc1af2f3-21c1-46f4-9440-e24f43b2f56f tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a36b83d3-7114-49dc-9632-48c0dacafbf8/action" status: 200 len: 32 microversion: 2.1 time: 0.136521 Apr 19 08:01:40 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 41/122] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 19 08:01:40 2023] POST /compute/v2.1/servers/a36b83d3-7114-49dc-9632-48c0dacafbf8/action => generated 32 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 19 08:01:40 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-a1b46e5c-e16b-4b66-83b9-15559b2349e1 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:01:40 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-a1b46e5c-e16b-4b66-83b9-15559b2349e1 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] [instance: a36b83d3-7114-49dc-9632-48c0dacafbf8] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:01:40 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-a1b46e5c-e16b-4b66-83b9-15559b2349e1 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:40 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-a1b46e5c-e16b-4b66-83b9-15559b2349e1 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:40 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-a1b46e5c-e16b-4b66-83b9-15559b2349e1 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:40 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-a1b46e5c-e16b-4b66-83b9-15559b2349e1 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:40 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-a1b46e5c-e16b-4b66-83b9-15559b2349e1 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:40 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-a1b46e5c-e16b-4b66-83b9-15559b2349e1 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:41 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-a1b46e5c-e16b-4b66-83b9-15559b2349e1 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9796d2c200d4419b0fe67d541efc8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173f7e00d8f748debe5a126203220f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:01:41 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-a1b46e5c-e16b-4b66-83b9-15559b2349e1 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a36b83d3-7114-49dc-9632-48c0dacafbf8" status: 200 len: 1510 microversion: 2.1 time: 0.235407 Apr 19 08:01:41 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 42/123] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:01:40 2023] GET /compute/v2.1/servers/a36b83d3-7114-49dc-9632-48c0dacafbf8 => generated 1510 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:01:41 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-16ba681e-4e0a-4f1f-87ea-75405072d125 req-0adff486-ac65-4efc-b690-fcd2f0b564d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36b83d3-7114-49dc-9632-48c0dacafbf8", "name": "network-vif-unplugged", "status": "completed", "tag": "f80986be-013a-49c0-bb54-96d55ce82748"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:01:41 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-16ba681e-4e0a-4f1f-87ea-75405072d125 req-0adff486-ac65-4efc-b690-fcd2f0b564d2 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:41 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-16ba681e-4e0a-4f1f-87ea-75405072d125 req-0adff486-ac65-4efc-b690-fcd2f0b564d2 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:41 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-16ba681e-4e0a-4f1f-87ea-75405072d125 req-0adff486-ac65-4efc-b690-fcd2f0b564d2 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:41 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-16ba681e-4e0a-4f1f-87ea-75405072d125 req-0adff486-ac65-4efc-b690-fcd2f0b564d2 service nova] Creating event network-vif-unplugged:f80986be-013a-49c0-bb54-96d55ce82748 for instance a36b83d3-7114-49dc-9632-48c0dacafbf8 on user Apr 19 08:01:41 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-16ba681e-4e0a-4f1f-87ea-75405072d125 req-0adff486-ac65-4efc-b690-fcd2f0b564d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032067 Apr 19 08:01:41 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 41/124] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:01:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:01:43 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-2b7bdcae-f877-4010-b296-5e49a02063c7 req-eb3da9af-bf6e-466d-81de-9b676c5a7d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36b83d3-7114-49dc-9632-48c0dacafbf8", "name": "network-vif-plugged", "status": "completed", "tag": "f80986be-013a-49c0-bb54-96d55ce82748"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:01:43 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-2b7bdcae-f877-4010-b296-5e49a02063c7 req-eb3da9af-bf6e-466d-81de-9b676c5a7d74 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:43 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-2b7bdcae-f877-4010-b296-5e49a02063c7 req-eb3da9af-bf6e-466d-81de-9b676c5a7d74 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:43 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-2b7bdcae-f877-4010-b296-5e49a02063c7 req-eb3da9af-bf6e-466d-81de-9b676c5a7d74 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:43 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-2b7bdcae-f877-4010-b296-5e49a02063c7 req-eb3da9af-bf6e-466d-81de-9b676c5a7d74 service nova] Creating event network-vif-plugged:f80986be-013a-49c0-bb54-96d55ce82748 for instance a36b83d3-7114-49dc-9632-48c0dacafbf8 on user Apr 19 08:01:43 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-2b7bdcae-f877-4010-b296-5e49a02063c7 req-eb3da9af-bf6e-466d-81de-9b676c5a7d74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027547 Apr 19 08:01:43 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 42/125] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:01:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:01:45 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-2f332c0a-770f-4a98-bb4e-8724f2740a44 req-028eda50-c78e-42a8-9693-7ceec5b2cf2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36b83d3-7114-49dc-9632-48c0dacafbf8", "name": "network-vif-plugged", "status": "completed", "tag": "f80986be-013a-49c0-bb54-96d55ce82748"}, {"server_uuid": "a36b83d3-7114-49dc-9632-48c0dacafbf8", "name": "network-vif-plugged", "status": "completed", "tag": "f80986be-013a-49c0-bb54-96d55ce82748"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:01:45 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-2f332c0a-770f-4a98-bb4e-8724f2740a44 req-028eda50-c78e-42a8-9693-7ceec5b2cf2f service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:45 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-2f332c0a-770f-4a98-bb4e-8724f2740a44 req-028eda50-c78e-42a8-9693-7ceec5b2cf2f service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:45 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-2f332c0a-770f-4a98-bb4e-8724f2740a44 req-028eda50-c78e-42a8-9693-7ceec5b2cf2f service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:45 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-2f332c0a-770f-4a98-bb4e-8724f2740a44 req-028eda50-c78e-42a8-9693-7ceec5b2cf2f service nova] Creating event network-vif-plugged:f80986be-013a-49c0-bb54-96d55ce82748 for instance a36b83d3-7114-49dc-9632-48c0dacafbf8 on user Apr 19 08:01:45 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-2f332c0a-770f-4a98-bb4e-8724f2740a44 req-028eda50-c78e-42a8-9693-7ceec5b2cf2f service nova] Creating event network-vif-plugged:f80986be-013a-49c0-bb54-96d55ce82748 for instance a36b83d3-7114-49dc-9632-48c0dacafbf8 on user Apr 19 08:01:45 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-2f332c0a-770f-4a98-bb4e-8724f2740a44 req-028eda50-c78e-42a8-9693-7ceec5b2cf2f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029953 Apr 19 08:01:45 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 43/126] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:01:45 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:01:49 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-251814c4-df26-4ad5-9c26-21c2c3e4ab66 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:01:49 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-251814c4-df26-4ad5-9c26-21c2c3e4ab66 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] [instance: 396bea78-4da8-4d59-b595-4617e997a3a0] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:01:49 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-251814c4-df26-4ad5-9c26-21c2c3e4ab66 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:49 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-251814c4-df26-4ad5-9c26-21c2c3e4ab66 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:49 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-251814c4-df26-4ad5-9c26-21c2c3e4ab66 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:49 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-251814c4-df26-4ad5-9c26-21c2c3e4ab66 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:49 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-251814c4-df26-4ad5-9c26-21c2c3e4ab66 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:49 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-251814c4-df26-4ad5-9c26-21c2c3e4ab66 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:49 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-251814c4-df26-4ad5-9c26-21c2c3e4ab66 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] 10.0.0.210 "GET /compute/v2.1/servers/396bea78-4da8-4d59-b595-4617e997a3a0/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.208878 Apr 19 08:01:49 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 42/127] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 08:01:49 2023] GET /compute/v2.1/servers/396bea78-4da8-4d59-b595-4617e997a3a0/os-interface => generated 282 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:01:51 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-c479258b-5506-4f00-a96b-d17c08a2e33c req-2befeaa2-7b92-4b1f-bc8b-8692d376ea87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "396bea78-4da8-4d59-b595-4617e997a3a0", "tag": "12688fad-698e-449f-870c-d3e7e2e603da"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:01:51 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-c479258b-5506-4f00-a96b-d17c08a2e33c req-2befeaa2-7b92-4b1f-bc8b-8692d376ea87 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:51 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-c479258b-5506-4f00-a96b-d17c08a2e33c req-2befeaa2-7b92-4b1f-bc8b-8692d376ea87 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:51 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-c479258b-5506-4f00-a96b-d17c08a2e33c req-2befeaa2-7b92-4b1f-bc8b-8692d376ea87 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:51 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-c479258b-5506-4f00-a96b-d17c08a2e33c req-2befeaa2-7b92-4b1f-bc8b-8692d376ea87 service nova] Creating event network-changed:12688fad-698e-449f-870c-d3e7e2e603da for instance 396bea78-4da8-4d59-b595-4617e997a3a0 on user Apr 19 08:01:51 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-c479258b-5506-4f00-a96b-d17c08a2e33c req-2befeaa2-7b92-4b1f-bc8b-8692d376ea87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031446 Apr 19 08:01:51 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 43/128] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:01:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:01:51 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-df7a6847-92b7-4045-a32c-ca1b17fa5267 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-684449017"}} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:01:51 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-df7a6847-92b7-4045-a32c-ca1b17fa5267 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] [instance: 396bea78-4da8-4d59-b595-4617e997a3a0] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:01:51 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-df7a6847-92b7-4045-a32c-ca1b17fa5267 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:51 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-df7a6847-92b7-4045-a32c-ca1b17fa5267 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:51 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-df7a6847-92b7-4045-a32c-ca1b17fa5267 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:51 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-df7a6847-92b7-4045-a32c-ca1b17fa5267 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:01:51 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-df7a6847-92b7-4045-a32c-ca1b17fa5267 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:01:51 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-df7a6847-92b7-4045-a32c-ca1b17fa5267 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:01:51 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-df7a6847-92b7-4045-a32c-ca1b17fa5267 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] 10.0.0.210 "POST /compute/v2.1/servers/396bea78-4da8-4d59-b595-4617e997a3a0/action" status: 202 len: 0 microversion: 2.1 time: 0.909027 Apr 19 08:01:51 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 44/129] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 19 08:01:51 2023] POST /compute/v2.1/servers/396bea78-4da8-4d59-b595-4617e997a3a0/action => generated 0 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 19 08:01:52 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-46bc7979-5d3c-4a38-bda7-22622e93cc79 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Calling method '.version_select at 0x7f2c0126bbe0>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:01:52 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-46bc7979-5d3c-4a38-bda7-22622e93cc79 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] 10.0.0.210 "GET /compute/v2.1/images/6f688f5a-65ae-455b-a4d6-9b148927c6ae" status: 200 len: 1610 microversion: 2.1 time: 0.058079 Apr 19 08:01:52 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 43/130] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 19 08:01:51 2023] GET /compute/v2.1/images/6f688f5a-65ae-455b-a4d6-9b148927c6ae => generated 1610 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:02:06 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:02:06 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:02:06 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-22451de1-43f7-4040-ac5d-0b98267d46e4 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:02:06 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-22451de1-43f7-4040-ac5d-0b98267d46e4 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] [instance: 47562492-07e0-43cb-979a-fd904c3bcf6c] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:02:06 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-22451de1-43f7-4040-ac5d-0b98267d46e4 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:06 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-22451de1-43f7-4040-ac5d-0b98267d46e4 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:06 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-22451de1-43f7-4040-ac5d-0b98267d46e4 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:06 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-22451de1-43f7-4040-ac5d-0b98267d46e4 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:06 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-22451de1-43f7-4040-ac5d-0b98267d46e4 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:06 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-22451de1-43f7-4040-ac5d-0b98267d46e4 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:07 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-22451de1-43f7-4040-ac5d-0b98267d46e4 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47562492-07e0-43cb-979a-fd904c3bcf6c/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.173369 Apr 19 08:02:07 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 44/131] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 08:02:06 2023] GET /compute/v2.1/servers/47562492-07e0-43cb-979a-fd904c3bcf6c/os-interface => generated 283 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:02:08 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=12 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:02:08 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:02:08 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-eecbdfb7-5664-411c-9783-381e3cfa15cd req-05876b63-9b98-4fc8-bf34-315b338f655f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47562492-07e0-43cb-979a-fd904c3bcf6c", "tag": "9aaae4fb-7881-479b-a7a4-10d4d96a3aff"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:02:08 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-eecbdfb7-5664-411c-9783-381e3cfa15cd req-05876b63-9b98-4fc8-bf34-315b338f655f service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:08 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-eecbdfb7-5664-411c-9783-381e3cfa15cd req-05876b63-9b98-4fc8-bf34-315b338f655f service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:08 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-eecbdfb7-5664-411c-9783-381e3cfa15cd req-05876b63-9b98-4fc8-bf34-315b338f655f service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:08 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-eecbdfb7-5664-411c-9783-381e3cfa15cd req-05876b63-9b98-4fc8-bf34-315b338f655f service nova] Creating event network-changed:9aaae4fb-7881-479b-a7a4-10d4d96a3aff for instance 47562492-07e0-43cb-979a-fd904c3bcf6c on user Apr 19 08:02:08 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-eecbdfb7-5664-411c-9783-381e3cfa15cd req-05876b63-9b98-4fc8-bf34-315b338f655f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042945 Apr 19 08:02:08 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 45/132] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:02:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:02:09 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-933e6f17-1470-4b16-b0dd-6cd3420a5769 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:02:09 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-933e6f17-1470-4b16-b0dd-6cd3420a5769 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] [instance: 47562492-07e0-43cb-979a-fd904c3bcf6c] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:02:09 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=10 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:02:09 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=16 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:02:09 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-933e6f17-1470-4b16-b0dd-6cd3420a5769 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:09 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-933e6f17-1470-4b16-b0dd-6cd3420a5769 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:09 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-933e6f17-1470-4b16-b0dd-6cd3420a5769 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:09 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-933e6f17-1470-4b16-b0dd-6cd3420a5769 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:09 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-933e6f17-1470-4b16-b0dd-6cd3420a5769 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:09 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-933e6f17-1470-4b16-b0dd-6cd3420a5769 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:09 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-933e6f17-1470-4b16-b0dd-6cd3420a5769 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] [instance: 47562492-07e0-43cb-979a-fd904c3bcf6c] Going to try to terminate instance {{(pid=61210) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:02:10 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-933e6f17-1470-4b16-b0dd-6cd3420a5769 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/47562492-07e0-43cb-979a-fd904c3bcf6c" status: 204 len: 0 microversion: 2.1 time: 0.450437 Apr 19 08:02:10 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 44/133] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:02:09 2023] DELETE /compute/v2.1/servers/47562492-07e0-43cb-979a-fd904c3bcf6c => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 08:02:10 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-3a433abc-8a2e-487b-9513-ee6b0c340415 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:02:10 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-3a433abc-8a2e-487b-9513-ee6b0c340415 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] [instance: 47562492-07e0-43cb-979a-fd904c3bcf6c] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:02:10 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-3a433abc-8a2e-487b-9513-ee6b0c340415 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:10 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-3a433abc-8a2e-487b-9513-ee6b0c340415 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:10 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-3a433abc-8a2e-487b-9513-ee6b0c340415 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:10 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-3a433abc-8a2e-487b-9513-ee6b0c340415 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:10 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-3a433abc-8a2e-487b-9513-ee6b0c340415 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:10 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-3a433abc-8a2e-487b-9513-ee6b0c340415 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:10 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-3a433abc-8a2e-487b-9513-ee6b0c340415 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b62de8ca3994e54ae9c9cd891a8f4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616eae3faffb4aaa9fbdae47ea8d5cba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:02:10 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-3a433abc-8a2e-487b-9513-ee6b0c340415 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47562492-07e0-43cb-979a-fd904c3bcf6c" status: 200 len: 1673 microversion: 2.1 time: 0.169094 Apr 19 08:02:10 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 45/134] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:02:10 2023] GET /compute/v2.1/servers/47562492-07e0-43cb-979a-fd904c3bcf6c => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:02:10 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-02dc4fc1-d346-4fe7-8c6a-8bb4ee88eec8 req-21096d90-30b4-4baf-9a1c-8a1c53faa7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47562492-07e0-43cb-979a-fd904c3bcf6c", "name": "network-vif-unplugged", "status": "completed", "tag": "9aaae4fb-7881-479b-a7a4-10d4d96a3aff"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:02:10 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-02dc4fc1-d346-4fe7-8c6a-8bb4ee88eec8 req-21096d90-30b4-4baf-9a1c-8a1c53faa7f5 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:10 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-02dc4fc1-d346-4fe7-8c6a-8bb4ee88eec8 req-21096d90-30b4-4baf-9a1c-8a1c53faa7f5 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:10 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-02dc4fc1-d346-4fe7-8c6a-8bb4ee88eec8 req-21096d90-30b4-4baf-9a1c-8a1c53faa7f5 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:10 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-02dc4fc1-d346-4fe7-8c6a-8bb4ee88eec8 req-21096d90-30b4-4baf-9a1c-8a1c53faa7f5 service nova] Creating event network-vif-unplugged:9aaae4fb-7881-479b-a7a4-10d4d96a3aff for instance 47562492-07e0-43cb-979a-fd904c3bcf6c on user Apr 19 08:02:10 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-02dc4fc1-d346-4fe7-8c6a-8bb4ee88eec8 req-21096d90-30b4-4baf-9a1c-8a1c53faa7f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029807 Apr 19 08:02:10 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 46/135] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:02:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:02:11 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-52f38c10-cc0a-429b-b6a3-c8005346f382 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:02:11 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-52f38c10-cc0a-429b-b6a3-c8005346f382 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] [instance: 4fae3aae-cb67-4c14-b358-59248d99238d] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:02:11 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-52f38c10-cc0a-429b-b6a3-c8005346f382 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:11 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-52f38c10-cc0a-429b-b6a3-c8005346f382 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:11 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-52f38c10-cc0a-429b-b6a3-c8005346f382 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:11 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-52f38c10-cc0a-429b-b6a3-c8005346f382 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:11 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-52f38c10-cc0a-429b-b6a3-c8005346f382 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:11 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-52f38c10-cc0a-429b-b6a3-c8005346f382 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:11 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-52f38c10-cc0a-429b-b6a3-c8005346f382 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fae3aae-cb67-4c14-b358-59248d99238d/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.255332 Apr 19 08:02:11 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 45/136] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 08:02:11 2023] GET /compute/v2.1/servers/4fae3aae-cb67-4c14-b358-59248d99238d/os-interface => generated 282 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:02:12 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-02ed6568-c733-45c8-b4b8-3030b2988a56 req-3aea0da8-e25a-4186-a977-13a4759379f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fae3aae-cb67-4c14-b358-59248d99238d", "tag": "0099c8b1-71b7-45a0-abe2-aeecf2e3e73b"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:02:12 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-02ed6568-c733-45c8-b4b8-3030b2988a56 req-3aea0da8-e25a-4186-a977-13a4759379f4 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:12 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-02ed6568-c733-45c8-b4b8-3030b2988a56 req-3aea0da8-e25a-4186-a977-13a4759379f4 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:12 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-02ed6568-c733-45c8-b4b8-3030b2988a56 req-3aea0da8-e25a-4186-a977-13a4759379f4 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:12 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-02ed6568-c733-45c8-b4b8-3030b2988a56 req-3aea0da8-e25a-4186-a977-13a4759379f4 service nova] Creating event network-changed:0099c8b1-71b7-45a0-abe2-aeecf2e3e73b for instance 4fae3aae-cb67-4c14-b358-59248d99238d on user Apr 19 08:02:12 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-02ed6568-c733-45c8-b4b8-3030b2988a56 req-3aea0da8-e25a-4186-a977-13a4759379f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034172 Apr 19 08:02:12 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 46/137] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:02:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:02:12 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-21a3810a-1bf9-4c5b-8131-5cf1e674fe99 req-4f42a3c3-e29c-41b6-9011-b2c1b1c80669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47562492-07e0-43cb-979a-fd904c3bcf6c", "name": "network-vif-deleted", "tag": "9aaae4fb-7881-479b-a7a4-10d4d96a3aff"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:02:12 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-21a3810a-1bf9-4c5b-8131-5cf1e674fe99 req-4f42a3c3-e29c-41b6-9011-b2c1b1c80669 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:12 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-21a3810a-1bf9-4c5b-8131-5cf1e674fe99 req-4f42a3c3-e29c-41b6-9011-b2c1b1c80669 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:12 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-21a3810a-1bf9-4c5b-8131-5cf1e674fe99 req-4f42a3c3-e29c-41b6-9011-b2c1b1c80669 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:12 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-21a3810a-1bf9-4c5b-8131-5cf1e674fe99 req-4f42a3c3-e29c-41b6-9011-b2c1b1c80669 service nova] Creating event network-vif-deleted:9aaae4fb-7881-479b-a7a4-10d4d96a3aff for instance 47562492-07e0-43cb-979a-fd904c3bcf6c on user Apr 19 08:02:12 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-21a3810a-1bf9-4c5b-8131-5cf1e674fe99 req-4f42a3c3-e29c-41b6-9011-b2c1b1c80669 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030556 Apr 19 08:02:12 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 47/138] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:02:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:02:12 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-64efffda-9b98-4313-a60f-e5ee02a5f34b req-b9865eaf-41d9-4bf2-8b28-4c993d4007ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47562492-07e0-43cb-979a-fd904c3bcf6c", "name": "network-vif-plugged", "status": "completed", "tag": "9aaae4fb-7881-479b-a7a4-10d4d96a3aff"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:02:12 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-64efffda-9b98-4313-a60f-e5ee02a5f34b req-b9865eaf-41d9-4bf2-8b28-4c993d4007ac service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:12 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-64efffda-9b98-4313-a60f-e5ee02a5f34b req-b9865eaf-41d9-4bf2-8b28-4c993d4007ac service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:12 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-64efffda-9b98-4313-a60f-e5ee02a5f34b req-b9865eaf-41d9-4bf2-8b28-4c993d4007ac service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:12 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-64efffda-9b98-4313-a60f-e5ee02a5f34b req-b9865eaf-41d9-4bf2-8b28-4c993d4007ac service nova] Creating event network-vif-plugged:9aaae4fb-7881-479b-a7a4-10d4d96a3aff for instance 47562492-07e0-43cb-979a-fd904c3bcf6c on user Apr 19 08:02:12 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-64efffda-9b98-4313-a60f-e5ee02a5f34b req-b9865eaf-41d9-4bf2-8b28-4c993d4007ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032320 Apr 19 08:02:12 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 46/139] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:02:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:02:13 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-e84166bf-86b3-4862-935b-0825131f25cf tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1957212964", "imageRef": "b515545f-3b22-4d80-a102-6a318ab9717a", "flavorRef": "42", "networks": [{"uuid": "6b5acefb-31b4-419b-92ef-02b730d2a899"}]}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:02:13 user devstack@n-api.service[61209]: DEBUG nova.network.neutron [None req-e84166bf-86b3-4862-935b-0825131f25cf tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] validate_networks() for [('6b5acefb-31b4-419b-92ef-02b730d2a899', None, None, None, None, None)] {{(pid=61209) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 08:02:14 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-e84166bf-86b3-4862-935b-0825131f25cf tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Flavor limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 08:02:14 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-e84166bf-86b3-4862-935b-0825131f25cf tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Image limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 08:02:14 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-e84166bf-86b3-4862-935b-0825131f25cf tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Flavor pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 08:02:14 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-e84166bf-86b3-4862-935b-0825131f25cf tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Image pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 08:02:14 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-e84166bf-86b3-4862-935b-0825131f25cf tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 08:02:14 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e84166bf-86b3-4862-935b-0825131f25cf tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:14 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e84166bf-86b3-4862-935b-0825131f25cf tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:14 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e84166bf-86b3-4862-935b-0825131f25cf tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:14 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e84166bf-86b3-4862-935b-0825131f25cf tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:14 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e84166bf-86b3-4862-935b-0825131f25cf tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:14 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e84166bf-86b3-4862-935b-0825131f25cf tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:14 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-e84166bf-86b3-4862-935b-0825131f25cf tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Getting quotas for project 463fd5763cb24abeae209399cb8ff073. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:02:14 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-e84166bf-86b3-4862-935b-0825131f25cf tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Getting quotas for user c38ef0fdb3c84ba9948b0806fd74f279 and project 463fd5763cb24abeae209399cb8ff073. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:02:14 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-e84166bf-86b3-4862-935b-0825131f25cf tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Going to run 1 instances... {{(pid=61209) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 08:02:14 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-e84166bf-86b3-4862-935b-0825131f25cf tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] [instance: 75492904-1918-41fb-baf0-0ce2c1e65194] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b515545f-3b22-4d80-a102-6a318ab9717a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 08:02:14 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-e84166bf-86b3-4862-935b-0825131f25cf tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.555900 Apr 19 08:02:14 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 47/140] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 08:02:13 2023] POST /compute/v2.1/servers => generated 378 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 08:02:14 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-c458f71e-8453-470b-8f16-ebbb1cf4f198 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:02:14 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-c458f71e-8453-470b-8f16-ebbb1cf4f198 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] [instance: 75492904-1918-41fb-baf0-0ce2c1e65194] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:02:14 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-c458f71e-8453-470b-8f16-ebbb1cf4f198 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef0fdb3c84ba9948b0806fd74f279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463fd5763cb24abeae209399cb8ff073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:02:14 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-c458f71e-8453-470b-8f16-ebbb1cf4f198 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75492904-1918-41fb-baf0-0ce2c1e65194" status: 200 len: 1212 microversion: 2.1 time: 0.068127 Apr 19 08:02:14 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 48/141] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:02:14 2023] GET /compute/v2.1/servers/75492904-1918-41fb-baf0-0ce2c1e65194 => generated 1212 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:02:16 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-9fd977fd-e55e-4493-906e-e4f68785ac70 req-7eeae09e-425e-403e-ada0-6ff2ed4b1b23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75492904-1918-41fb-baf0-0ce2c1e65194", "tag": "2d6b93cd-ee00-45c5-86f0-8d54e73a9e78"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:02:16 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-9fd977fd-e55e-4493-906e-e4f68785ac70 req-7eeae09e-425e-403e-ada0-6ff2ed4b1b23 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:16 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-9fd977fd-e55e-4493-906e-e4f68785ac70 req-7eeae09e-425e-403e-ada0-6ff2ed4b1b23 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:16 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-9fd977fd-e55e-4493-906e-e4f68785ac70 req-7eeae09e-425e-403e-ada0-6ff2ed4b1b23 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:16 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-9fd977fd-e55e-4493-906e-e4f68785ac70 req-7eeae09e-425e-403e-ada0-6ff2ed4b1b23 service nova] Creating event network-changed:2d6b93cd-ee00-45c5-86f0-8d54e73a9e78 for instance 75492904-1918-41fb-baf0-0ce2c1e65194 on user Apr 19 08:02:16 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-9fd977fd-e55e-4493-906e-e4f68785ac70 req-7eeae09e-425e-403e-ada0-6ff2ed4b1b23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033803 Apr 19 08:02:16 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 47/142] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:02:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:02:18 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-5290e491-7612-4efe-89ac-f7ba7bfedfd7 req-20c0c485-8f72-4ab8-8e32-7b434f94691c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75492904-1918-41fb-baf0-0ce2c1e65194", "name": "network-vif-plugged", "status": "completed", "tag": "2d6b93cd-ee00-45c5-86f0-8d54e73a9e78"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:02:18 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-5290e491-7612-4efe-89ac-f7ba7bfedfd7 req-20c0c485-8f72-4ab8-8e32-7b434f94691c service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:18 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-5290e491-7612-4efe-89ac-f7ba7bfedfd7 req-20c0c485-8f72-4ab8-8e32-7b434f94691c service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:18 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-5290e491-7612-4efe-89ac-f7ba7bfedfd7 req-20c0c485-8f72-4ab8-8e32-7b434f94691c service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:18 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-5290e491-7612-4efe-89ac-f7ba7bfedfd7 req-20c0c485-8f72-4ab8-8e32-7b434f94691c service nova] Creating event network-vif-plugged:2d6b93cd-ee00-45c5-86f0-8d54e73a9e78 for instance 75492904-1918-41fb-baf0-0ce2c1e65194 on user Apr 19 08:02:18 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-5290e491-7612-4efe-89ac-f7ba7bfedfd7 req-20c0c485-8f72-4ab8-8e32-7b434f94691c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030110 Apr 19 08:02:18 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 48/143] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:02:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:02:21 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-dad11c5d-8871-4cad-a0cd-40199f162fdb req-30bf95fd-d7d3-46a7-9665-f4d422253d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75492904-1918-41fb-baf0-0ce2c1e65194", "name": "network-vif-plugged", "status": "completed", "tag": "2d6b93cd-ee00-45c5-86f0-8d54e73a9e78"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:02:21 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-dad11c5d-8871-4cad-a0cd-40199f162fdb req-30bf95fd-d7d3-46a7-9665-f4d422253d03 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:21 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-dad11c5d-8871-4cad-a0cd-40199f162fdb req-30bf95fd-d7d3-46a7-9665-f4d422253d03 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:21 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-dad11c5d-8871-4cad-a0cd-40199f162fdb req-30bf95fd-d7d3-46a7-9665-f4d422253d03 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:21 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-dad11c5d-8871-4cad-a0cd-40199f162fdb req-30bf95fd-d7d3-46a7-9665-f4d422253d03 service nova] Creating event network-vif-plugged:2d6b93cd-ee00-45c5-86f0-8d54e73a9e78 for instance 75492904-1918-41fb-baf0-0ce2c1e65194 on user Apr 19 08:02:21 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-dad11c5d-8871-4cad-a0cd-40199f162fdb req-30bf95fd-d7d3-46a7-9665-f4d422253d03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030401 Apr 19 08:02:21 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 49/144] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:02:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:02:25 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-cf20ce57-8bb4-4c95-9fc1-50fe9289e92d tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:02:25 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-cf20ce57-8bb4-4c95-9fc1-50fe9289e92d tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] [instance: d9311d99-6120-473a-bb42-47a0e6fb78ff] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:02:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-cf20ce57-8bb4-4c95-9fc1-50fe9289e92d tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-cf20ce57-8bb4-4c95-9fc1-50fe9289e92d tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-cf20ce57-8bb4-4c95-9fc1-50fe9289e92d tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-cf20ce57-8bb4-4c95-9fc1-50fe9289e92d tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-cf20ce57-8bb4-4c95-9fc1-50fe9289e92d tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-cf20ce57-8bb4-4c95-9fc1-50fe9289e92d tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:25 user devstack@n-api.service[61210]: INFO nova.api.openstack.wsgi [None req-cf20ce57-8bb4-4c95-9fc1-50fe9289e92d tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] HTTP exception thrown: Instance d9311d99-6120-473a-bb42-47a0e6fb78ff could not be found. Apr 19 08:02:25 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-cf20ce57-8bb4-4c95-9fc1-50fe9289e92d tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Request method failure captured: Apr 19 08:02:25 user devstack@n-api.service[61210]: request: GET /compute/v2.1/servers/d9311d99-6120-473a-bb42-47a0e6fb78ff HTTP/1.1 Apr 19 08:02:25 user devstack@n-api.service[61210]: Accept: application/json Apr 19 08:02:25 user devstack@n-api.service[61210]: Accept-Encoding: identity Apr 19 08:02:25 user devstack@n-api.service[61210]: Connection: close Apr 19 08:02:25 user devstack@n-api.service[61210]: Content-Length: 0 Apr 19 08:02:25 user devstack@n-api.service[61210]: Content-Type: application/json Apr 19 08:02:25 user devstack@n-api.service[61210]: Host: 10.0.0.210 Apr 19 08:02:25 user devstack@n-api.service[61210]: Openstack-System-Scope: None Apr 19 08:02:25 user devstack@n-api.service[61210]: User-Agent: python-urllib3/1.26.15 Apr 19 08:02:25 user devstack@n-api.service[61210]: X-Auth-Token: gAAAAABkP59qHFpoCG7Xg_-k2sOrTobU5KcFzQrUwi06FD1QUndbnUXDse6OB_N5AzmiAOfy9mHrQ4_d04RyKkk7VijZZ_Wzn07dcMvqhU9o2nEiVA13cwadAsfVwl8MIW5Iwo0d7CsGK0NJpE9SWSh9QgBgo3uGY685ULb6WFFh_oF_tbqTjRQ Apr 19 08:02:25 user devstack@n-api.service[61210]: X-Domain-Id: None Apr 19 08:02:25 user devstack@n-api.service[61210]: X-Domain-Name: None Apr 19 08:02:25 user devstack@n-api.service[61210]: X-Identity-Status: Confirmed Apr 19 08:02:25 user devstack@n-api.service[61210]: X-Is-Admin-Project: True Apr 19 08:02:25 user devstack@n-api.service[61210]: X-Project-Domain-Id: default Apr 19 08:02:25 user devstack@n-api.service[61210]: X-Project-Domain-Name: Default Apr 19 08:02:25 user devstack@n-api.service[61210]: X-Project-Id: be03dec99bf14fe4baa07ed4e4b7d433 Apr 19 08:02:25 user devstack@n-api.service[61210]: X-Project-Name: tempest-DeleteServersTestJSON-222429247 Apr 19 08:02:25 user devstack@n-api.service[61210]: X-Role: reader,member Apr 19 08:02:25 user devstack@n-api.service[61210]: X-Roles: reader,member Apr 19 08:02:25 user devstack@n-api.service[61210]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be03dec99bf14fe4baa07ed4e4b7d433"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/be03dec99bf14fe4baa07ed4e4b7d433"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be03dec99bf14fe4baa07ed4e4b7d433"}]}] Apr 19 08:02:25 user devstack@n-api.service[61210]: X-Tenant: tempest-DeleteServersTestJSON-222429247 Apr 19 08:02:25 user devstack@n-api.service[61210]: X-Tenant-Id: be03dec99bf14fe4baa07ed4e4b7d433 Apr 19 08:02:25 user devstack@n-api.service[61210]: X-Tenant-Name: tempest-DeleteServersTestJSON-222429247 Apr 19 08:02:25 user devstack@n-api.service[61210]: X-User: tempest-DeleteServersTestJSON-222429247-project-member Apr 19 08:02:25 user devstack@n-api.service[61210]: X-User-Domain-Id: default Apr 19 08:02:25 user devstack@n-api.service[61210]: X-User-Domain-Name: Default Apr 19 08:02:25 user devstack@n-api.service[61210]: X-User-Id: ee39a220ed4c41d58dc529a568e4e81a Apr 19 08:02:25 user devstack@n-api.service[61210]: X-User-Name: tempest-DeleteServersTestJSON-222429247-project-member Apr 19 08:02:25 user devstack@n-api.service[61210]: method: > Apr 19 08:02:25 user devstack@n-api.service[61210]: exception: Instance d9311d99-6120-473a-bb42-47a0e6fb78ff could not be found. Apr 19 08:02:25 user devstack@n-api.service[61210]: action_args: {'id': 'd9311d99-6120-473a-bb42-47a0e6fb78ff'} Apr 19 08:02:25 user devstack@n-api.service[61210]: {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9311d99-6120-473a-bb42-47a0e6fb78ff could not be found. Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9311d99-6120-473a-bb42-47a0e6fb78ff could not be found. Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9311d99-6120-473a-bb42-47a0e6fb78ff could not be found. Apr 19 08:02:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:02:25 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-cf20ce57-8bb4-4c95-9fc1-50fe9289e92d tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] Returning 404 to user: Instance d9311d99-6120-473a-bb42-47a0e6fb78ff could not be found. {{(pid=61210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:02:25 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-cf20ce57-8bb4-4c95-9fc1-50fe9289e92d tempest-DeleteServersTestJSON-222429247 tempest-DeleteServersTestJSON-222429247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9311d99-6120-473a-bb42-47a0e6fb78ff" status: 404 len: 111 microversion: 2.1 time: 0.035693 Apr 19 08:02:25 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 48/145] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:02:25 2023] GET /compute/v2.1/servers/d9311d99-6120-473a-bb42-47a0e6fb78ff => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:02:26 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:02:26 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=6 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:02:26 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-5fbba0a2-bb3f-4dc9-bbd7-10c110b96807 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:02:26 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-5fbba0a2-bb3f-4dc9-bbd7-10c110b96807 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] [instance: 729daf9c-359b-41f7-a15a-6460beab58c8] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:02:26 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5fbba0a2-bb3f-4dc9-bbd7-10c110b96807 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:26 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5fbba0a2-bb3f-4dc9-bbd7-10c110b96807 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:26 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5fbba0a2-bb3f-4dc9-bbd7-10c110b96807 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:26 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5fbba0a2-bb3f-4dc9-bbd7-10c110b96807 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:26 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5fbba0a2-bb3f-4dc9-bbd7-10c110b96807 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:26 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5fbba0a2-bb3f-4dc9-bbd7-10c110b96807 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:26 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-5fbba0a2-bb3f-4dc9-bbd7-10c110b96807 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32cbfb3d854d56ad3961da3f406e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8362c8d404717b2fa6e510f1de07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:02:26 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-5fbba0a2-bb3f-4dc9-bbd7-10c110b96807 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] 10.0.0.210 "GET /compute/v2.1/servers/729daf9c-359b-41f7-a15a-6460beab58c8" status: 200 len: 1537 microversion: 2.1 time: 0.235178 Apr 19 08:02:26 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 49/146] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:02:26 2023] GET /compute/v2.1/servers/729daf9c-359b-41f7-a15a-6460beab58c8 => generated 1537 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:02:26 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:02:26 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-b2f49c2d-7d88-4b6a-a8ba-f6ab18114fba tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:02:26 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-b2f49c2d-7d88-4b6a-a8ba-f6ab18114fba tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3d32cbfb3d854d56ad3961da3f406e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8362c8d404717b2fa6e510f1de07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:02:26 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-b2f49c2d-7d88-4b6a-a8ba-f6ab18114fba tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Searching by: {'deleted': False, 'project_id': 'd5e8362c8d404717b2fa6e510f1de07a'} {{(pid=61208) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 19 08:02:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b2f49c2d-7d88-4b6a-a8ba-f6ab18114fba tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b2f49c2d-7d88-4b6a-a8ba-f6ab18114fba tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b2f49c2d-7d88-4b6a-a8ba-f6ab18114fba tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b2f49c2d-7d88-4b6a-a8ba-f6ab18114fba tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b2f49c2d-7d88-4b6a-a8ba-f6ab18114fba tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b2f49c2d-7d88-4b6a-a8ba-f6ab18114fba tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:26 user devstack@n-api.service[61208]: DEBUG nova.compute.multi_cell_list [None req-b2f49c2d-7d88-4b6a-a8ba-f6ab18114fba tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61208) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 19 08:02:27 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-b2f49c2d-7d88-4b6a-a8ba-f6ab18114fba tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.559049 Apr 19 08:02:27 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 50/147] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 19 08:02:26 2023] GET /compute/v2.1/servers => generated 341 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:02:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-8af9adca-6136-4aaf-a592-cac562582e73 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:02:27 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-8af9adca-6136-4aaf-a592-cac562582e73 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] [instance: 729daf9c-359b-41f7-a15a-6460beab58c8] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:02:27 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-8af9adca-6136-4aaf-a592-cac562582e73 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:27 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-8af9adca-6136-4aaf-a592-cac562582e73 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:27 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-8af9adca-6136-4aaf-a592-cac562582e73 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:27 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-8af9adca-6136-4aaf-a592-cac562582e73 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:27 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-8af9adca-6136-4aaf-a592-cac562582e73 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:27 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-8af9adca-6136-4aaf-a592-cac562582e73 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:27 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-8af9adca-6136-4aaf-a592-cac562582e73 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32cbfb3d854d56ad3961da3f406e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8362c8d404717b2fa6e510f1de07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:02:27 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-8af9adca-6136-4aaf-a592-cac562582e73 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] 10.0.0.210 "GET /compute/v2.1/servers/729daf9c-359b-41f7-a15a-6460beab58c8" status: 200 len: 1537 microversion: 2.1 time: 0.273889 Apr 19 08:02:27 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 49/148] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:02:27 2023] GET /compute/v2.1/servers/729daf9c-359b-41f7-a15a-6460beab58c8 => generated 1537 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:02:28 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-32efe717-a8f4-47d4-acbe-e7743e7cf12b tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:02:28 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-32efe717-a8f4-47d4-acbe-e7743e7cf12b tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] [instance: 729daf9c-359b-41f7-a15a-6460beab58c8] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:02:28 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-32efe717-a8f4-47d4-acbe-e7743e7cf12b tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:28 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-32efe717-a8f4-47d4-acbe-e7743e7cf12b tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:28 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-32efe717-a8f4-47d4-acbe-e7743e7cf12b tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:28 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-32efe717-a8f4-47d4-acbe-e7743e7cf12b tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:28 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-32efe717-a8f4-47d4-acbe-e7743e7cf12b tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:28 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-32efe717-a8f4-47d4-acbe-e7743e7cf12b tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:28 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-32efe717-a8f4-47d4-acbe-e7743e7cf12b tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] [instance: 729daf9c-359b-41f7-a15a-6460beab58c8] Going to try to terminate instance {{(pid=61209) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:02:28 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-32efe717-a8f4-47d4-acbe-e7743e7cf12b tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/729daf9c-359b-41f7-a15a-6460beab58c8" status: 204 len: 0 microversion: 2.1 time: 0.127531 Apr 19 08:02:28 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 50/149] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:02:28 2023] DELETE /compute/v2.1/servers/729daf9c-359b-41f7-a15a-6460beab58c8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 08:02:28 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-b48c0f46-ea9e-464d-a54a-ccad6020afd8 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:02:28 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-b48c0f46-ea9e-464d-a54a-ccad6020afd8 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] [instance: 729daf9c-359b-41f7-a15a-6460beab58c8] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:02:28 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b48c0f46-ea9e-464d-a54a-ccad6020afd8 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:28 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b48c0f46-ea9e-464d-a54a-ccad6020afd8 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:28 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b48c0f46-ea9e-464d-a54a-ccad6020afd8 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:29 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b48c0f46-ea9e-464d-a54a-ccad6020afd8 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:29 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b48c0f46-ea9e-464d-a54a-ccad6020afd8 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:29 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b48c0f46-ea9e-464d-a54a-ccad6020afd8 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:29 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-59d40368-891c-45c8-a3d8-3b5597ad645d req-f082e0b6-03cf-49f0-9510-7f54ac2fcbbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "729daf9c-359b-41f7-a15a-6460beab58c8", "name": "network-vif-unplugged", "status": "completed", "tag": "733cba40-6008-4900-8f4f-cd8b0396b3fb"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:02:29 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-59d40368-891c-45c8-a3d8-3b5597ad645d req-f082e0b6-03cf-49f0-9510-7f54ac2fcbbc service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:29 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-59d40368-891c-45c8-a3d8-3b5597ad645d req-f082e0b6-03cf-49f0-9510-7f54ac2fcbbc service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:29 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-59d40368-891c-45c8-a3d8-3b5597ad645d req-f082e0b6-03cf-49f0-9510-7f54ac2fcbbc service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:29 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-59d40368-891c-45c8-a3d8-3b5597ad645d req-f082e0b6-03cf-49f0-9510-7f54ac2fcbbc service nova] Creating event network-vif-unplugged:733cba40-6008-4900-8f4f-cd8b0396b3fb for instance 729daf9c-359b-41f7-a15a-6460beab58c8 on user Apr 19 08:02:29 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-59d40368-891c-45c8-a3d8-3b5597ad645d req-f082e0b6-03cf-49f0-9510-7f54ac2fcbbc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034067 Apr 19 08:02:29 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 50/150] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:02:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:02:29 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-b48c0f46-ea9e-464d-a54a-ccad6020afd8 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32cbfb3d854d56ad3961da3f406e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8362c8d404717b2fa6e510f1de07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:02:29 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-b48c0f46-ea9e-464d-a54a-ccad6020afd8 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] 10.0.0.210 "GET /compute/v2.1/servers/729daf9c-359b-41f7-a15a-6460beab58c8" status: 200 len: 1543 microversion: 2.1 time: 0.292568 Apr 19 08:02:29 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 51/151] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:02:28 2023] GET /compute/v2.1/servers/729daf9c-359b-41f7-a15a-6460beab58c8 => generated 1543 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:02:30 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-8a8dbf74-9968-40e1-9039-b877f8d6fae4 req-2ede28dc-440f-4de8-865c-beb670de9dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "729daf9c-359b-41f7-a15a-6460beab58c8", "name": "network-vif-deleted", "tag": "733cba40-6008-4900-8f4f-cd8b0396b3fb"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:02:30 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-8a8dbf74-9968-40e1-9039-b877f8d6fae4 req-2ede28dc-440f-4de8-865c-beb670de9dd2 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:30 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-8a8dbf74-9968-40e1-9039-b877f8d6fae4 req-2ede28dc-440f-4de8-865c-beb670de9dd2 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:30 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-8a8dbf74-9968-40e1-9039-b877f8d6fae4 req-2ede28dc-440f-4de8-865c-beb670de9dd2 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:30 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-8a8dbf74-9968-40e1-9039-b877f8d6fae4 req-2ede28dc-440f-4de8-865c-beb670de9dd2 service nova] Creating event network-vif-deleted:733cba40-6008-4900-8f4f-cd8b0396b3fb for instance 729daf9c-359b-41f7-a15a-6460beab58c8 on user Apr 19 08:02:30 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-8a8dbf74-9968-40e1-9039-b877f8d6fae4 req-2ede28dc-440f-4de8-865c-beb670de9dd2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029252 Apr 19 08:02:30 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 51/152] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:02:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:02:31 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-c2b5dc78-8214-4cbc-9846-7a36856276b7 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:02:31 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-c2b5dc78-8214-4cbc-9846-7a36856276b7 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] [instance: a36b83d3-7114-49dc-9632-48c0dacafbf8] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:02:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-c2b5dc78-8214-4cbc-9846-7a36856276b7 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-c2b5dc78-8214-4cbc-9846-7a36856276b7 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-c2b5dc78-8214-4cbc-9846-7a36856276b7 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-c2b5dc78-8214-4cbc-9846-7a36856276b7 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-c2b5dc78-8214-4cbc-9846-7a36856276b7 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-c2b5dc78-8214-4cbc-9846-7a36856276b7 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:31 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-a726b12a-415e-4a9d-bedc-4a97abbb5123 req-7a453cf7-77d0-4c8d-84f2-38d69ec00ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "729daf9c-359b-41f7-a15a-6460beab58c8", "name": "network-vif-plugged", "status": "completed", "tag": "733cba40-6008-4900-8f4f-cd8b0396b3fb"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:02:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-a726b12a-415e-4a9d-bedc-4a97abbb5123 req-7a453cf7-77d0-4c8d-84f2-38d69ec00ce6 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-a726b12a-415e-4a9d-bedc-4a97abbb5123 req-7a453cf7-77d0-4c8d-84f2-38d69ec00ce6 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-a726b12a-415e-4a9d-bedc-4a97abbb5123 req-7a453cf7-77d0-4c8d-84f2-38d69ec00ce6 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:31 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-a726b12a-415e-4a9d-bedc-4a97abbb5123 req-7a453cf7-77d0-4c8d-84f2-38d69ec00ce6 service nova] Creating event network-vif-plugged:733cba40-6008-4900-8f4f-cd8b0396b3fb for instance 729daf9c-359b-41f7-a15a-6460beab58c8 on user Apr 19 08:02:31 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-a726b12a-415e-4a9d-bedc-4a97abbb5123 req-7a453cf7-77d0-4c8d-84f2-38d69ec00ce6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029067 Apr 19 08:02:31 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 52/153] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:02:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:02:31 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-c2b5dc78-8214-4cbc-9846-7a36856276b7 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9796d2c200d4419b0fe67d541efc8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173f7e00d8f748debe5a126203220f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:02:31 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-c2b5dc78-8214-4cbc-9846-7a36856276b7 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a36b83d3-7114-49dc-9632-48c0dacafbf8" status: 200 len: 1490 microversion: 2.1 time: 0.233343 Apr 19 08:02:31 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 51/154] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:02:31 2023] GET /compute/v2.1/servers/a36b83d3-7114-49dc-9632-48c0dacafbf8 => generated 1490 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:02:34 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-882ce6e2-44b8-4dd9-b977-439b21018e32 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:02:34 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-882ce6e2-44b8-4dd9-b977-439b21018e32 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] [instance: 5eb02260-a7ea-4b05-8d8d-72950cfce57b] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:02:34 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-882ce6e2-44b8-4dd9-b977-439b21018e32 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:34 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-882ce6e2-44b8-4dd9-b977-439b21018e32 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:34 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-882ce6e2-44b8-4dd9-b977-439b21018e32 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:34 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-882ce6e2-44b8-4dd9-b977-439b21018e32 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:34 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-882ce6e2-44b8-4dd9-b977-439b21018e32 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:34 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-882ce6e2-44b8-4dd9-b977-439b21018e32 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:34 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-882ce6e2-44b8-4dd9-b977-439b21018e32 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5eb02260-a7ea-4b05-8d8d-72950cfce57b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.157917 Apr 19 08:02:34 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 52/155] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 08:02:34 2023] GET /compute/v2.1/servers/5eb02260-a7ea-4b05-8d8d-72950cfce57b/os-interface => generated 282 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:02:35 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-531f8657-233d-4cb5-8c45-c3ef34e40590 req-e1608dfa-8ca9-410a-9c15-69f83b193c05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eb02260-a7ea-4b05-8d8d-72950cfce57b", "tag": "dde1193b-2522-4f45-9742-39f340a3f35f"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:02:35 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-531f8657-233d-4cb5-8c45-c3ef34e40590 req-e1608dfa-8ca9-410a-9c15-69f83b193c05 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:35 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-531f8657-233d-4cb5-8c45-c3ef34e40590 req-e1608dfa-8ca9-410a-9c15-69f83b193c05 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:35 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-531f8657-233d-4cb5-8c45-c3ef34e40590 req-e1608dfa-8ca9-410a-9c15-69f83b193c05 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:35 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-531f8657-233d-4cb5-8c45-c3ef34e40590 req-e1608dfa-8ca9-410a-9c15-69f83b193c05 service nova] Creating event network-changed:dde1193b-2522-4f45-9742-39f340a3f35f for instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b on user Apr 19 08:02:35 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-531f8657-233d-4cb5-8c45-c3ef34e40590 req-e1608dfa-8ca9-410a-9c15-69f83b193c05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034246 Apr 19 08:02:35 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 53/156] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:02:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:02:35 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-6454643c-7fc7-4e0a-bfb6-6c81488b2be2 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:02:35 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-6454643c-7fc7-4e0a-bfb6-6c81488b2be2 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] [instance: 5eb02260-a7ea-4b05-8d8d-72950cfce57b] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:02:35 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6454643c-7fc7-4e0a-bfb6-6c81488b2be2 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:35 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6454643c-7fc7-4e0a-bfb6-6c81488b2be2 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:35 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6454643c-7fc7-4e0a-bfb6-6c81488b2be2 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:35 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6454643c-7fc7-4e0a-bfb6-6c81488b2be2 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:35 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6454643c-7fc7-4e0a-bfb6-6c81488b2be2 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:35 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6454643c-7fc7-4e0a-bfb6-6c81488b2be2 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:35 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-6454643c-7fc7-4e0a-bfb6-6c81488b2be2 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5eb02260-a7ea-4b05-8d8d-72950cfce57b/ips" status: 200 len: 104 microversion: 2.1 time: 0.049006 Apr 19 08:02:35 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 52/157] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 08:02:35 2023] GET /compute/v2.1/servers/5eb02260-a7ea-4b05-8d8d-72950cfce57b/ips => generated 104 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:02:35 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-76057831-1e5e-4b57-977a-b1d3281f79af tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:02:35 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-76057831-1e5e-4b57-977a-b1d3281f79af tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] [instance: bdeeb437-76a3-49b5-9553-d2da74917d69] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:02:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-76057831-1e5e-4b57-977a-b1d3281f79af tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-76057831-1e5e-4b57-977a-b1d3281f79af tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-76057831-1e5e-4b57-977a-b1d3281f79af tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-76057831-1e5e-4b57-977a-b1d3281f79af tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-76057831-1e5e-4b57-977a-b1d3281f79af tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-76057831-1e5e-4b57-977a-b1d3281f79af tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:35 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-76057831-1e5e-4b57-977a-b1d3281f79af tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.168746 Apr 19 08:02:35 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 53/158] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 08:02:35 2023] GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69/os-interface => generated 283 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:02:36 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:02:36 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-36f52778-62fe-4bb2-ba1d-96a1afe03017 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:02:36 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-36f52778-62fe-4bb2-ba1d-96a1afe03017 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] [instance: 5eb02260-a7ea-4b05-8d8d-72950cfce57b] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:02:36 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-36f52778-62fe-4bb2-ba1d-96a1afe03017 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:36 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-36f52778-62fe-4bb2-ba1d-96a1afe03017 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:36 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-36f52778-62fe-4bb2-ba1d-96a1afe03017 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:36 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-36f52778-62fe-4bb2-ba1d-96a1afe03017 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:36 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-36f52778-62fe-4bb2-ba1d-96a1afe03017 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:36 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-36f52778-62fe-4bb2-ba1d-96a1afe03017 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:36 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-36f52778-62fe-4bb2-ba1d-96a1afe03017 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] [instance: 5eb02260-a7ea-4b05-8d8d-72950cfce57b] Going to try to terminate instance {{(pid=61208) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:02:36 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-56edb472-6fbd-4b10-a769-f605324b9981 req-8d298df1-6c97-4c82-9718-1769b1a4bb33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdeeb437-76a3-49b5-9553-d2da74917d69", "tag": "8cebef39-d819-436e-9047-40d02c752d9e"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:02:36 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-56edb472-6fbd-4b10-a769-f605324b9981 req-8d298df1-6c97-4c82-9718-1769b1a4bb33 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:36 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-56edb472-6fbd-4b10-a769-f605324b9981 req-8d298df1-6c97-4c82-9718-1769b1a4bb33 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:36 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-56edb472-6fbd-4b10-a769-f605324b9981 req-8d298df1-6c97-4c82-9718-1769b1a4bb33 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:37 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-56edb472-6fbd-4b10-a769-f605324b9981 req-8d298df1-6c97-4c82-9718-1769b1a4bb33 service nova] Creating event network-changed:8cebef39-d819-436e-9047-40d02c752d9e for instance bdeeb437-76a3-49b5-9553-d2da74917d69 on user Apr 19 08:02:37 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-56edb472-6fbd-4b10-a769-f605324b9981 req-8d298df1-6c97-4c82-9718-1769b1a4bb33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032883 Apr 19 08:02:37 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 53/159] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:02:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:02:37 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-4fd49394-91df-4e90-81a3-4e37af6bc677 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:02:37 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-4fd49394-91df-4e90-81a3-4e37af6bc677 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] [instance: bdeeb437-76a3-49b5-9553-d2da74917d69] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:02:37 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:02:37 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-4fd49394-91df-4e90-81a3-4e37af6bc677 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:37 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-36f52778-62fe-4bb2-ba1d-96a1afe03017 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5eb02260-a7ea-4b05-8d8d-72950cfce57b" status: 204 len: 0 microversion: 2.1 time: 0.130432 Apr 19 08:02:37 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-4fd49394-91df-4e90-81a3-4e37af6bc677 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:37 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-4fd49394-91df-4e90-81a3-4e37af6bc677 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:37 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 54/160] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:02:36 2023] DELETE /compute/v2.1/servers/5eb02260-a7ea-4b05-8d8d-72950cfce57b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 08:02:37 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-4fd49394-91df-4e90-81a3-4e37af6bc677 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:37 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-4fd49394-91df-4e90-81a3-4e37af6bc677 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:37 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-4fd49394-91df-4e90-81a3-4e37af6bc677 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:37 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:02:37 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-8b7a2eea-23c3-4d3e-a7b9-0c11d4eccf0a tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:02:37 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-8b7a2eea-23c3-4d3e-a7b9-0c11d4eccf0a tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] [instance: 5eb02260-a7ea-4b05-8d8d-72950cfce57b] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:02:37 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-8b7a2eea-23c3-4d3e-a7b9-0c11d4eccf0a tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:37 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-8b7a2eea-23c3-4d3e-a7b9-0c11d4eccf0a tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:37 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-8b7a2eea-23c3-4d3e-a7b9-0c11d4eccf0a tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:37 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-8b7a2eea-23c3-4d3e-a7b9-0c11d4eccf0a tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:37 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-8b7a2eea-23c3-4d3e-a7b9-0c11d4eccf0a tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:37 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-8b7a2eea-23c3-4d3e-a7b9-0c11d4eccf0a tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:37 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-8b7a2eea-23c3-4d3e-a7b9-0c11d4eccf0a tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f18935b0524876bf69f22cff03139a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d73100ea55541d08952a24ef6931a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:02:37 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-8b7a2eea-23c3-4d3e-a7b9-0c11d4eccf0a tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5eb02260-a7ea-4b05-8d8d-72950cfce57b" status: 200 len: 1663 microversion: 2.1 time: 0.253043 Apr 19 08:02:37 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 54/161] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:02:37 2023] GET /compute/v2.1/servers/5eb02260-a7ea-4b05-8d8d-72950cfce57b => generated 1663 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:02:37 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-4fd49394-91df-4e90-81a3-4e37af6bc677 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dc2a88f2d149a1a4035ed1c7e74b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcde8c2a3444e919d232ea854c00e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:02:37 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-4fd49394-91df-4e90-81a3-4e37af6bc677 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69" status: 200 len: 1539 microversion: 2.1 time: 0.303205 Apr 19 08:02:37 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 54/162] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:02:37 2023] GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69 => generated 1539 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:02:37 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-9088a54a-a485-4c34-987a-c5eff9c0a3f9 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:02:37 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-9088a54a-a485-4c34-987a-c5eff9c0a3f9 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] [instance: bdeeb437-76a3-49b5-9553-d2da74917d69] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:02:37 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-9088a54a-a485-4c34-987a-c5eff9c0a3f9 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:37 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-9088a54a-a485-4c34-987a-c5eff9c0a3f9 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:37 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-9088a54a-a485-4c34-987a-c5eff9c0a3f9 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:37 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-9088a54a-a485-4c34-987a-c5eff9c0a3f9 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:37 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-9088a54a-a485-4c34-987a-c5eff9c0a3f9 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:37 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-9088a54a-a485-4c34-987a-c5eff9c0a3f9 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:37 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-8df3debe-14f7-4020-8582-c2ed496507d6 req-d07ad813-cf07-42d6-b2f1-81bb2d394781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb02260-a7ea-4b05-8d8d-72950cfce57b", "name": "network-vif-unplugged", "status": "completed", "tag": "dde1193b-2522-4f45-9742-39f340a3f35f"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:02:37 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-8df3debe-14f7-4020-8582-c2ed496507d6 req-d07ad813-cf07-42d6-b2f1-81bb2d394781 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:37 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-8df3debe-14f7-4020-8582-c2ed496507d6 req-d07ad813-cf07-42d6-b2f1-81bb2d394781 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:37 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-8df3debe-14f7-4020-8582-c2ed496507d6 req-d07ad813-cf07-42d6-b2f1-81bb2d394781 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:37 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-8df3debe-14f7-4020-8582-c2ed496507d6 req-d07ad813-cf07-42d6-b2f1-81bb2d394781 service nova] Creating event network-vif-unplugged:dde1193b-2522-4f45-9742-39f340a3f35f for instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b on user Apr 19 08:02:37 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-8df3debe-14f7-4020-8582-c2ed496507d6 req-d07ad813-cf07-42d6-b2f1-81bb2d394781 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027703 Apr 19 08:02:37 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 55/163] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:02:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:02:37 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-9088a54a-a485-4c34-987a-c5eff9c0a3f9 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dc2a88f2d149a1a4035ed1c7e74b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcde8c2a3444e919d232ea854c00e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:02:37 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-9088a54a-a485-4c34-987a-c5eff9c0a3f9 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69" status: 200 len: 1539 microversion: 2.1 time: 0.298796 Apr 19 08:02:37 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 55/164] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:02:37 2023] GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69 => generated 1539 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:02:38 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-452aa2d7-2b98-4c5d-a747-8e63ba65bb6c req-a0c0e081-87f3-4a53-929c-b13d3413fdf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb02260-a7ea-4b05-8d8d-72950cfce57b", "name": "network-vif-deleted", "tag": "dde1193b-2522-4f45-9742-39f340a3f35f"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:02:38 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-452aa2d7-2b98-4c5d-a747-8e63ba65bb6c req-a0c0e081-87f3-4a53-929c-b13d3413fdf9 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:38 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-452aa2d7-2b98-4c5d-a747-8e63ba65bb6c req-a0c0e081-87f3-4a53-929c-b13d3413fdf9 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:38 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-452aa2d7-2b98-4c5d-a747-8e63ba65bb6c req-a0c0e081-87f3-4a53-929c-b13d3413fdf9 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:38 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-452aa2d7-2b98-4c5d-a747-8e63ba65bb6c req-a0c0e081-87f3-4a53-929c-b13d3413fdf9 service nova] Creating event network-vif-deleted:dde1193b-2522-4f45-9742-39f340a3f35f for instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b on user Apr 19 08:02:38 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-452aa2d7-2b98-4c5d-a747-8e63ba65bb6c req-a0c0e081-87f3-4a53-929c-b13d3413fdf9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027644 Apr 19 08:02:38 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 55/165] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:02:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:02:39 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-f04fefdd-a671-4623-8da3-13e9d94b7b9f req-af3a44a4-09f5-461a-a9f8-d4dae1620d2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb02260-a7ea-4b05-8d8d-72950cfce57b", "name": "network-vif-plugged", "status": "completed", "tag": "dde1193b-2522-4f45-9742-39f340a3f35f"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:02:39 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-f04fefdd-a671-4623-8da3-13e9d94b7b9f req-af3a44a4-09f5-461a-a9f8-d4dae1620d2b service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:39 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-f04fefdd-a671-4623-8da3-13e9d94b7b9f req-af3a44a4-09f5-461a-a9f8-d4dae1620d2b service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:39 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-f04fefdd-a671-4623-8da3-13e9d94b7b9f req-af3a44a4-09f5-461a-a9f8-d4dae1620d2b service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:39 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-f04fefdd-a671-4623-8da3-13e9d94b7b9f req-af3a44a4-09f5-461a-a9f8-d4dae1620d2b service nova] Creating event network-vif-plugged:dde1193b-2522-4f45-9742-39f340a3f35f for instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b on user Apr 19 08:02:39 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-f04fefdd-a671-4623-8da3-13e9d94b7b9f req-af3a44a4-09f5-461a-a9f8-d4dae1620d2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040196 Apr 19 08:02:39 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 56/166] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:02:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:02:42 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-47d3caa4-cd8a-4779-818e-640df5f23149 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Calling method '.version_select at 0x7f2c012a2830>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:02:42 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-47d3caa4-cd8a-4779-818e-640df5f23149 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] 10.0.0.210 "GET /compute/v2.1/images/6f688f5a-65ae-455b-a4d6-9b148927c6ae" status: 200 len: 1724 microversion: 2.1 time: 0.050216 Apr 19 08:02:42 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 56/167] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 19 08:02:42 2023] GET /compute/v2.1/images/6f688f5a-65ae-455b-a4d6-9b148927c6ae => generated 1724 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:02:42 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-7e4b2168-e355-443d-9d7e-f83e0140f3fa tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Calling method '.version_select at 0x7f2c012f5b40>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:02:42 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-7e4b2168-e355-443d-9d7e-f83e0140f3fa tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] 10.0.0.210 "GET /compute/v2.1/images/6f688f5a-65ae-455b-a4d6-9b148927c6ae" status: 200 len: 1724 microversion: 2.1 time: 0.051033 Apr 19 08:02:42 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 56/168] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 19 08:02:42 2023] GET /compute/v2.1/images/6f688f5a-65ae-455b-a4d6-9b148927c6ae => generated 1724 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:02:42 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-3bb063ac-5c4e-4bcd-aa08-9185026229b3 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:02:42 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-3bb063ac-5c4e-4bcd-aa08-9185026229b3 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] [instance: 396bea78-4da8-4d59-b595-4617e997a3a0] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:02:42 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:02:42 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-3bb063ac-5c4e-4bcd-aa08-9185026229b3 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:42 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-3bb063ac-5c4e-4bcd-aa08-9185026229b3 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:42 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-3bb063ac-5c4e-4bcd-aa08-9185026229b3 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:42 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-3bb063ac-5c4e-4bcd-aa08-9185026229b3 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:02:42 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-3bb063ac-5c4e-4bcd-aa08-9185026229b3 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:02:42 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-3bb063ac-5c4e-4bcd-aa08-9185026229b3 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:02:42 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:02:42 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-3bb063ac-5c4e-4bcd-aa08-9185026229b3 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519a9c3c2f6e4c01a0115f12885554ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22007f1c0da74c8aa2bfea0a0d1e1b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:02:42 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-3bb063ac-5c4e-4bcd-aa08-9185026229b3 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] 10.0.0.210 "GET /compute/v2.1/servers/396bea78-4da8-4d59-b595-4617e997a3a0" status: 200 len: 1670 microversion: 2.1 time: 0.227228 Apr 19 08:02:42 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 57/169] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:02:42 2023] GET /compute/v2.1/servers/396bea78-4da8-4d59-b595-4617e997a3a0 => generated 1670 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:03:00 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:03:00 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:03:00 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-974b4aff-36a5-4ef6-8fe9-733fc56fa9d5 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:00 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-974b4aff-36a5-4ef6-8fe9-733fc56fa9d5 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] [instance: 47562492-07e0-43cb-979a-fd904c3bcf6c] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:03:00 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-974b4aff-36a5-4ef6-8fe9-733fc56fa9d5 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:00 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-974b4aff-36a5-4ef6-8fe9-733fc56fa9d5 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:00 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-974b4aff-36a5-4ef6-8fe9-733fc56fa9d5 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:00 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-974b4aff-36a5-4ef6-8fe9-733fc56fa9d5 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:00 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-974b4aff-36a5-4ef6-8fe9-733fc56fa9d5 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:00 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-974b4aff-36a5-4ef6-8fe9-733fc56fa9d5 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:00 user devstack@n-api.service[61208]: INFO nova.api.openstack.wsgi [None req-974b4aff-36a5-4ef6-8fe9-733fc56fa9d5 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] HTTP exception thrown: Instance 47562492-07e0-43cb-979a-fd904c3bcf6c could not be found. Apr 19 08:03:00 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-974b4aff-36a5-4ef6-8fe9-733fc56fa9d5 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Request method failure captured: Apr 19 08:03:00 user devstack@n-api.service[61208]: request: GET /compute/v2.1/servers/47562492-07e0-43cb-979a-fd904c3bcf6c HTTP/1.1 Apr 19 08:03:00 user devstack@n-api.service[61208]: Accept: application/json Apr 19 08:03:00 user devstack@n-api.service[61208]: Accept-Encoding: identity Apr 19 08:03:00 user devstack@n-api.service[61208]: Connection: close Apr 19 08:03:00 user devstack@n-api.service[61208]: Content-Length: 0 Apr 19 08:03:00 user devstack@n-api.service[61208]: Content-Type: application/json Apr 19 08:03:00 user devstack@n-api.service[61208]: Host: 10.0.0.210 Apr 19 08:03:00 user devstack@n-api.service[61208]: Openstack-System-Scope: None Apr 19 08:03:00 user devstack@n-api.service[61208]: User-Agent: python-urllib3/1.26.15 Apr 19 08:03:00 user devstack@n-api.service[61208]: X-Auth-Token: gAAAAABkP59oM715v1p__0jCM6mibDW5ZAkVHJLGJcyvwcHuMTFOIVdNYNJK_pp8LvckIjB-qqLT1epMstEgryWVEPrW2Zt0-OseFOIs1ruUbgZ_IHpAcGJ_mBVZgJUV4ioIz5Im-WmQ_fVFhEvchO3bX5XRLSY5860-VH7KXLRTLvzPr5YEq88 Apr 19 08:03:00 user devstack@n-api.service[61208]: X-Domain-Id: None Apr 19 08:03:00 user devstack@n-api.service[61208]: X-Domain-Name: None Apr 19 08:03:00 user devstack@n-api.service[61208]: X-Identity-Status: Confirmed Apr 19 08:03:00 user devstack@n-api.service[61208]: X-Is-Admin-Project: True Apr 19 08:03:00 user devstack@n-api.service[61208]: X-Project-Domain-Id: default Apr 19 08:03:00 user devstack@n-api.service[61208]: X-Project-Domain-Name: Default Apr 19 08:03:00 user devstack@n-api.service[61208]: X-Project-Id: 616eae3faffb4aaa9fbdae47ea8d5cba Apr 19 08:03:00 user devstack@n-api.service[61208]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-895000539 Apr 19 08:03:00 user devstack@n-api.service[61208]: X-Role: reader,member Apr 19 08:03:00 user devstack@n-api.service[61208]: X-Roles: reader,member Apr 19 08:03:00 user devstack@n-api.service[61208]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/616eae3faffb4aaa9fbdae47ea8d5cba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/616eae3faffb4aaa9fbdae47ea8d5cba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/616eae3faffb4aaa9fbdae47ea8d5cba"}]}] Apr 19 08:03:00 user devstack@n-api.service[61208]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-895000539 Apr 19 08:03:00 user devstack@n-api.service[61208]: X-Tenant-Id: 616eae3faffb4aaa9fbdae47ea8d5cba Apr 19 08:03:00 user devstack@n-api.service[61208]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-895000539 Apr 19 08:03:00 user devstack@n-api.service[61208]: X-User: tempest-AttachSCSIVolumeTestJSON-895000539-project-member Apr 19 08:03:00 user devstack@n-api.service[61208]: X-User-Domain-Id: default Apr 19 08:03:00 user devstack@n-api.service[61208]: X-User-Domain-Name: Default Apr 19 08:03:00 user devstack@n-api.service[61208]: X-User-Id: 2b62de8ca3994e54ae9c9cd891a8f4fe Apr 19 08:03:00 user devstack@n-api.service[61208]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-895000539-project-member Apr 19 08:03:00 user devstack@n-api.service[61208]: method: > Apr 19 08:03:00 user devstack@n-api.service[61208]: exception: Instance 47562492-07e0-43cb-979a-fd904c3bcf6c could not be found. Apr 19 08:03:00 user devstack@n-api.service[61208]: action_args: {'id': '47562492-07e0-43cb-979a-fd904c3bcf6c'} Apr 19 08:03:00 user devstack@n-api.service[61208]: {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47562492-07e0-43cb-979a-fd904c3bcf6c could not be found. Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47562492-07e0-43cb-979a-fd904c3bcf6c could not be found. Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47562492-07e0-43cb-979a-fd904c3bcf6c could not be found. Apr 19 08:03:00 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:03:00 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-974b4aff-36a5-4ef6-8fe9-733fc56fa9d5 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Returning 404 to user: Instance 47562492-07e0-43cb-979a-fd904c3bcf6c could not be found. {{(pid=61208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:03:00 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-974b4aff-36a5-4ef6-8fe9-733fc56fa9d5 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47562492-07e0-43cb-979a-fd904c3bcf6c" status: 404 len: 111 microversion: 2.1 time: 0.048421 Apr 19 08:03:00 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 57/170] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:03:00 2023] GET /compute/v2.1/servers/47562492-07e0-43cb-979a-fd904c3bcf6c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:03:00 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-48a3fe35-a341-4fc1-9558-2fca22691355 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Calling method '.version_select at 0x7f2c012f7640>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:00 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=3 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:03:00 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=7 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:03:00 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-48a3fe35-a341-4fc1-9558-2fca22691355 tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1837993463" status: 202 len: 0 microversion: 2.1 time: 0.031632 Apr 19 08:03:00 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 57/171] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 08:03:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1837993463 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 08:03:01 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-e51459ab-8523-47eb-a477-89769b44dbdb tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:01 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-e51459ab-8523-47eb-a477-89769b44dbdb tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] [instance: 47562492-07e0-43cb-979a-fd904c3bcf6c] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:03:01 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=1 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:03:01 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=5 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:03:01 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e51459ab-8523-47eb-a477-89769b44dbdb tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:01 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e51459ab-8523-47eb-a477-89769b44dbdb tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:01 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e51459ab-8523-47eb-a477-89769b44dbdb tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:01 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e51459ab-8523-47eb-a477-89769b44dbdb tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:01 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e51459ab-8523-47eb-a477-89769b44dbdb tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:01 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e51459ab-8523-47eb-a477-89769b44dbdb tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:01 user devstack@n-api.service[61210]: INFO nova.api.openstack.wsgi [None req-e51459ab-8523-47eb-a477-89769b44dbdb tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] HTTP exception thrown: Instance 47562492-07e0-43cb-979a-fd904c3bcf6c could not be found. Apr 19 08:03:01 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-e51459ab-8523-47eb-a477-89769b44dbdb tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Request method failure captured: Apr 19 08:03:01 user devstack@n-api.service[61210]: request: DELETE /compute/v2.1/servers/47562492-07e0-43cb-979a-fd904c3bcf6c HTTP/1.1 Apr 19 08:03:01 user devstack@n-api.service[61210]: Accept: application/json Apr 19 08:03:01 user devstack@n-api.service[61210]: Accept-Encoding: identity Apr 19 08:03:01 user devstack@n-api.service[61210]: Connection: close Apr 19 08:03:01 user devstack@n-api.service[61210]: Content-Length: 0 Apr 19 08:03:01 user devstack@n-api.service[61210]: Content-Type: application/json Apr 19 08:03:01 user devstack@n-api.service[61210]: Host: 10.0.0.210 Apr 19 08:03:01 user devstack@n-api.service[61210]: Openstack-System-Scope: None Apr 19 08:03:01 user devstack@n-api.service[61210]: User-Agent: python-urllib3/1.26.15 Apr 19 08:03:01 user devstack@n-api.service[61210]: X-Auth-Token: gAAAAABkP59oM715v1p__0jCM6mibDW5ZAkVHJLGJcyvwcHuMTFOIVdNYNJK_pp8LvckIjB-qqLT1epMstEgryWVEPrW2Zt0-OseFOIs1ruUbgZ_IHpAcGJ_mBVZgJUV4ioIz5Im-WmQ_fVFhEvchO3bX5XRLSY5860-VH7KXLRTLvzPr5YEq88 Apr 19 08:03:01 user devstack@n-api.service[61210]: X-Domain-Id: None Apr 19 08:03:01 user devstack@n-api.service[61210]: X-Domain-Name: None Apr 19 08:03:01 user devstack@n-api.service[61210]: X-Identity-Status: Confirmed Apr 19 08:03:01 user devstack@n-api.service[61210]: X-Is-Admin-Project: True Apr 19 08:03:01 user devstack@n-api.service[61210]: X-Project-Domain-Id: default Apr 19 08:03:01 user devstack@n-api.service[61210]: X-Project-Domain-Name: Default Apr 19 08:03:01 user devstack@n-api.service[61210]: X-Project-Id: 616eae3faffb4aaa9fbdae47ea8d5cba Apr 19 08:03:01 user devstack@n-api.service[61210]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-895000539 Apr 19 08:03:01 user devstack@n-api.service[61210]: X-Role: reader,member Apr 19 08:03:01 user devstack@n-api.service[61210]: X-Roles: reader,member Apr 19 08:03:01 user devstack@n-api.service[61210]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/616eae3faffb4aaa9fbdae47ea8d5cba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/616eae3faffb4aaa9fbdae47ea8d5cba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/616eae3faffb4aaa9fbdae47ea8d5cba"}]}] Apr 19 08:03:01 user devstack@n-api.service[61210]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-895000539 Apr 19 08:03:01 user devstack@n-api.service[61210]: X-Tenant-Id: 616eae3faffb4aaa9fbdae47ea8d5cba Apr 19 08:03:01 user devstack@n-api.service[61210]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-895000539 Apr 19 08:03:01 user devstack@n-api.service[61210]: X-User: tempest-AttachSCSIVolumeTestJSON-895000539-project-member Apr 19 08:03:01 user devstack@n-api.service[61210]: X-User-Domain-Id: default Apr 19 08:03:01 user devstack@n-api.service[61210]: X-User-Domain-Name: Default Apr 19 08:03:01 user devstack@n-api.service[61210]: X-User-Id: 2b62de8ca3994e54ae9c9cd891a8f4fe Apr 19 08:03:01 user devstack@n-api.service[61210]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-895000539-project-member Apr 19 08:03:01 user devstack@n-api.service[61210]: method: > Apr 19 08:03:01 user devstack@n-api.service[61210]: exception: Instance 47562492-07e0-43cb-979a-fd904c3bcf6c could not be found. Apr 19 08:03:01 user devstack@n-api.service[61210]: action_args: {'id': '47562492-07e0-43cb-979a-fd904c3bcf6c'} Apr 19 08:03:01 user devstack@n-api.service[61210]: {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47562492-07e0-43cb-979a-fd904c3bcf6c could not be found. Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47562492-07e0-43cb-979a-fd904c3bcf6c could not be found. Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47562492-07e0-43cb-979a-fd904c3bcf6c could not be found. Apr 19 08:03:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:03:01 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-e51459ab-8523-47eb-a477-89769b44dbdb tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Returning 404 to user: Instance 47562492-07e0-43cb-979a-fd904c3bcf6c could not be found. {{(pid=61210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:03:01 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-e51459ab-8523-47eb-a477-89769b44dbdb tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/47562492-07e0-43cb-979a-fd904c3bcf6c" status: 404 len: 111 microversion: 2.1 time: 0.033982 Apr 19 08:03:01 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 58/172] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:03:01 2023] DELETE /compute/v2.1/servers/47562492-07e0-43cb-979a-fd904c3bcf6c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 19 08:03:01 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-a58a0bc0-f61c-4136-8e34-d5f799e4039a tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:01 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-a58a0bc0-f61c-4136-8e34-d5f799e4039a tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] [instance: 47562492-07e0-43cb-979a-fd904c3bcf6c] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:03:01 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-a58a0bc0-f61c-4136-8e34-d5f799e4039a tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:01 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-a58a0bc0-f61c-4136-8e34-d5f799e4039a tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:01 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-a58a0bc0-f61c-4136-8e34-d5f799e4039a tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:01 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-a58a0bc0-f61c-4136-8e34-d5f799e4039a tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:01 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-a58a0bc0-f61c-4136-8e34-d5f799e4039a tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:01 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-a58a0bc0-f61c-4136-8e34-d5f799e4039a tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:01 user devstack@n-api.service[61208]: INFO nova.api.openstack.wsgi [None req-a58a0bc0-f61c-4136-8e34-d5f799e4039a tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] HTTP exception thrown: Instance 47562492-07e0-43cb-979a-fd904c3bcf6c could not be found. Apr 19 08:03:01 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-a58a0bc0-f61c-4136-8e34-d5f799e4039a tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Request method failure captured: Apr 19 08:03:01 user devstack@n-api.service[61208]: request: GET /compute/v2.1/servers/47562492-07e0-43cb-979a-fd904c3bcf6c HTTP/1.1 Apr 19 08:03:01 user devstack@n-api.service[61208]: Accept: application/json Apr 19 08:03:01 user devstack@n-api.service[61208]: Accept-Encoding: identity Apr 19 08:03:01 user devstack@n-api.service[61208]: Connection: close Apr 19 08:03:01 user devstack@n-api.service[61208]: Content-Length: 0 Apr 19 08:03:01 user devstack@n-api.service[61208]: Content-Type: application/json Apr 19 08:03:01 user devstack@n-api.service[61208]: Host: 10.0.0.210 Apr 19 08:03:01 user devstack@n-api.service[61208]: Openstack-System-Scope: None Apr 19 08:03:01 user devstack@n-api.service[61208]: User-Agent: python-urllib3/1.26.15 Apr 19 08:03:01 user devstack@n-api.service[61208]: X-Auth-Token: gAAAAABkP59oM715v1p__0jCM6mibDW5ZAkVHJLGJcyvwcHuMTFOIVdNYNJK_pp8LvckIjB-qqLT1epMstEgryWVEPrW2Zt0-OseFOIs1ruUbgZ_IHpAcGJ_mBVZgJUV4ioIz5Im-WmQ_fVFhEvchO3bX5XRLSY5860-VH7KXLRTLvzPr5YEq88 Apr 19 08:03:01 user devstack@n-api.service[61208]: X-Domain-Id: None Apr 19 08:03:01 user devstack@n-api.service[61208]: X-Domain-Name: None Apr 19 08:03:01 user devstack@n-api.service[61208]: X-Identity-Status: Confirmed Apr 19 08:03:01 user devstack@n-api.service[61208]: X-Is-Admin-Project: True Apr 19 08:03:01 user devstack@n-api.service[61208]: X-Project-Domain-Id: default Apr 19 08:03:01 user devstack@n-api.service[61208]: X-Project-Domain-Name: Default Apr 19 08:03:01 user devstack@n-api.service[61208]: X-Project-Id: 616eae3faffb4aaa9fbdae47ea8d5cba Apr 19 08:03:01 user devstack@n-api.service[61208]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-895000539 Apr 19 08:03:01 user devstack@n-api.service[61208]: X-Role: reader,member Apr 19 08:03:01 user devstack@n-api.service[61208]: X-Roles: reader,member Apr 19 08:03:01 user devstack@n-api.service[61208]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/616eae3faffb4aaa9fbdae47ea8d5cba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/616eae3faffb4aaa9fbdae47ea8d5cba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/616eae3faffb4aaa9fbdae47ea8d5cba"}]}] Apr 19 08:03:01 user devstack@n-api.service[61208]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-895000539 Apr 19 08:03:01 user devstack@n-api.service[61208]: X-Tenant-Id: 616eae3faffb4aaa9fbdae47ea8d5cba Apr 19 08:03:01 user devstack@n-api.service[61208]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-895000539 Apr 19 08:03:01 user devstack@n-api.service[61208]: X-User: tempest-AttachSCSIVolumeTestJSON-895000539-project-member Apr 19 08:03:01 user devstack@n-api.service[61208]: X-User-Domain-Id: default Apr 19 08:03:01 user devstack@n-api.service[61208]: X-User-Domain-Name: Default Apr 19 08:03:01 user devstack@n-api.service[61208]: X-User-Id: 2b62de8ca3994e54ae9c9cd891a8f4fe Apr 19 08:03:01 user devstack@n-api.service[61208]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-895000539-project-member Apr 19 08:03:01 user devstack@n-api.service[61208]: method: > Apr 19 08:03:01 user devstack@n-api.service[61208]: exception: Instance 47562492-07e0-43cb-979a-fd904c3bcf6c could not be found. Apr 19 08:03:01 user devstack@n-api.service[61208]: action_args: {'id': '47562492-07e0-43cb-979a-fd904c3bcf6c'} Apr 19 08:03:01 user devstack@n-api.service[61208]: {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47562492-07e0-43cb-979a-fd904c3bcf6c could not be found. Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47562492-07e0-43cb-979a-fd904c3bcf6c could not be found. Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47562492-07e0-43cb-979a-fd904c3bcf6c could not be found. Apr 19 08:03:01 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:03:01 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-a58a0bc0-f61c-4136-8e34-d5f799e4039a tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] Returning 404 to user: Instance 47562492-07e0-43cb-979a-fd904c3bcf6c could not be found. {{(pid=61208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:03:01 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-a58a0bc0-f61c-4136-8e34-d5f799e4039a tempest-AttachSCSIVolumeTestJSON-895000539 tempest-AttachSCSIVolumeTestJSON-895000539-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47562492-07e0-43cb-979a-fd904c3bcf6c" status: 404 len: 111 microversion: 2.1 time: 0.027623 Apr 19 08:03:01 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 58/173] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:03:01 2023] GET /compute/v2.1/servers/47562492-07e0-43cb-979a-fd904c3bcf6c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:03:04 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-c6ea6e49-df53-40e6-a6f2-8c641904686d tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:04 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-c6ea6e49-df53-40e6-a6f2-8c641904686d tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] [instance: 75492904-1918-41fb-baf0-0ce2c1e65194] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:03:04 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c6ea6e49-df53-40e6-a6f2-8c641904686d tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:04 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c6ea6e49-df53-40e6-a6f2-8c641904686d tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:04 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c6ea6e49-df53-40e6-a6f2-8c641904686d tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:04 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c6ea6e49-df53-40e6-a6f2-8c641904686d tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:04 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c6ea6e49-df53-40e6-a6f2-8c641904686d tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:04 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c6ea6e49-df53-40e6-a6f2-8c641904686d tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:04 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-c6ea6e49-df53-40e6-a6f2-8c641904686d tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef0fdb3c84ba9948b0806fd74f279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463fd5763cb24abeae209399cb8ff073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:03:04 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-c6ea6e49-df53-40e6-a6f2-8c641904686d tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75492904-1918-41fb-baf0-0ce2c1e65194" status: 200 len: 1495 microversion: 2.1 time: 0.318096 Apr 19 08:03:04 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 58/174] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:03:04 2023] GET /compute/v2.1/servers/75492904-1918-41fb-baf0-0ce2c1e65194 => generated 1495 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:03:06 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-49e5ac43-f0eb-4849-a1e4-36820e380c19 tempest-TestVolumeBootPattern-1280395809 tempest-TestVolumeBootPattern-1280395809-project-member] Action: 'create', calling method: .version_select at 0x7f2c011f3f40>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-391790353", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyVqCdiChFWmzRTLEeKvUfr1lYiM9KGw4gBDx3vvFvBZAVQZCNcYeKjeEcA0XeBDzssUcc10kv8Rwv9CipVvalj5oDQ32+YuD/EraOCkg4Wyke+HgrrUkmqkeaIxtaOqQ=="}} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:03:06 user devstack@n-api.service[61210]: DEBUG nova.quota [None req-49e5ac43-f0eb-4849-a1e4-36820e380c19 tempest-TestVolumeBootPattern-1280395809 tempest-TestVolumeBootPattern-1280395809-project-member] Getting quotas for project 7f2984ffdae745169c67254fd396ac2b. Resources: {'key_pairs'} {{(pid=61210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:03:06 user devstack@n-api.service[61210]: DEBUG nova.quota [None req-49e5ac43-f0eb-4849-a1e4-36820e380c19 tempest-TestVolumeBootPattern-1280395809 tempest-TestVolumeBootPattern-1280395809-project-member] Getting quotas for user 864bd45391ca4eb6a8b3f03d97c6c335 and project 7f2984ffdae745169c67254fd396ac2b. Resources: {'key_pairs'} {{(pid=61210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:03:06 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-49e5ac43-f0eb-4849-a1e4-36820e380c19 tempest-TestVolumeBootPattern-1280395809 tempest-TestVolumeBootPattern-1280395809-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.072997 Apr 19 08:03:06 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 59/175] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 08:03:06 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:03:09 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-5264f70e-b8a1-4cd2-b414-7a1a5d441a60 tempest-TestVolumeBootPattern-1280395809 tempest-TestVolumeBootPattern-1280395809-project-member] Calling method '.version_select at 0x7f2c00f4dbd0>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:09 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-5264f70e-b8a1-4cd2-b414-7a1a5d441a60 tempest-TestVolumeBootPattern-1280395809 tempest-TestVolumeBootPattern-1280395809-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-391790353" status: 202 len: 0 microversion: 2.1 time: 0.024050 Apr 19 08:03:09 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 59/176] 10.0.0.210 () {62 vars in 1337 bytes} [Wed Apr 19 08:03:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-391790353 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 08:03:19 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:03:19 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=6 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:03:19 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-56ccc6b2-9386-4909-9697-086d97116e79 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:19 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-56ccc6b2-9386-4909-9697-086d97116e79 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] [instance: 729daf9c-359b-41f7-a15a-6460beab58c8] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:03:19 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-56ccc6b2-9386-4909-9697-086d97116e79 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:19 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-56ccc6b2-9386-4909-9697-086d97116e79 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:19 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-56ccc6b2-9386-4909-9697-086d97116e79 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:19 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-56ccc6b2-9386-4909-9697-086d97116e79 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:19 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-56ccc6b2-9386-4909-9697-086d97116e79 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:19 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-56ccc6b2-9386-4909-9697-086d97116e79 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:19 user devstack@n-api.service[61209]: INFO nova.api.openstack.wsgi [None req-56ccc6b2-9386-4909-9697-086d97116e79 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] HTTP exception thrown: Instance 729daf9c-359b-41f7-a15a-6460beab58c8 could not be found. Apr 19 08:03:19 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-56ccc6b2-9386-4909-9697-086d97116e79 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Request method failure captured: Apr 19 08:03:19 user devstack@n-api.service[61209]: request: GET /compute/v2.1/servers/729daf9c-359b-41f7-a15a-6460beab58c8 HTTP/1.1 Apr 19 08:03:19 user devstack@n-api.service[61209]: Accept: application/json Apr 19 08:03:19 user devstack@n-api.service[61209]: Accept-Encoding: identity Apr 19 08:03:19 user devstack@n-api.service[61209]: Connection: close Apr 19 08:03:19 user devstack@n-api.service[61209]: Content-Length: 0 Apr 19 08:03:19 user devstack@n-api.service[61209]: Content-Type: application/json Apr 19 08:03:19 user devstack@n-api.service[61209]: Host: 10.0.0.210 Apr 19 08:03:19 user devstack@n-api.service[61209]: Openstack-System-Scope: None Apr 19 08:03:19 user devstack@n-api.service[61209]: User-Agent: python-urllib3/1.26.15 Apr 19 08:03:19 user devstack@n-api.service[61209]: X-Auth-Token: gAAAAABkP5-Qk_GFYz0uu85MhVYHw_43UKBuy3GKXVwIo4gRbT4r8O3b_QqQw9jzY2gM8qhhV9wEa_42Occkzq8k903HxLHxXxoaDMMx_lLQVBdG_fOMJaudAWo3LXdbKID3kjkLlERHTFq9pPWy5ZZ29n_QUn7dMcQos6_y8HG4uqvAaZxMtVg Apr 19 08:03:19 user devstack@n-api.service[61209]: X-Domain-Id: None Apr 19 08:03:19 user devstack@n-api.service[61209]: X-Domain-Name: None Apr 19 08:03:19 user devstack@n-api.service[61209]: X-Identity-Status: Confirmed Apr 19 08:03:19 user devstack@n-api.service[61209]: X-Is-Admin-Project: True Apr 19 08:03:19 user devstack@n-api.service[61209]: X-Project-Domain-Id: default Apr 19 08:03:19 user devstack@n-api.service[61209]: X-Project-Domain-Name: Default Apr 19 08:03:19 user devstack@n-api.service[61209]: X-Project-Id: d5e8362c8d404717b2fa6e510f1de07a Apr 19 08:03:19 user devstack@n-api.service[61209]: X-Project-Name: tempest-TestMinimumBasicScenario-1741504408 Apr 19 08:03:19 user devstack@n-api.service[61209]: X-Role: reader,member Apr 19 08:03:19 user devstack@n-api.service[61209]: X-Roles: reader,member Apr 19 08:03:19 user devstack@n-api.service[61209]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5e8362c8d404717b2fa6e510f1de07a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5e8362c8d404717b2fa6e510f1de07a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5e8362c8d404717b2fa6e510f1de07a"}]}] Apr 19 08:03:19 user devstack@n-api.service[61209]: X-Tenant: tempest-TestMinimumBasicScenario-1741504408 Apr 19 08:03:19 user devstack@n-api.service[61209]: X-Tenant-Id: d5e8362c8d404717b2fa6e510f1de07a Apr 19 08:03:19 user devstack@n-api.service[61209]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1741504408 Apr 19 08:03:19 user devstack@n-api.service[61209]: X-User: tempest-TestMinimumBasicScenario-1741504408-project-member Apr 19 08:03:19 user devstack@n-api.service[61209]: X-User-Domain-Id: default Apr 19 08:03:19 user devstack@n-api.service[61209]: X-User-Domain-Name: Default Apr 19 08:03:19 user devstack@n-api.service[61209]: X-User-Id: 3d32cbfb3d854d56ad3961da3f406e77 Apr 19 08:03:19 user devstack@n-api.service[61209]: X-User-Name: tempest-TestMinimumBasicScenario-1741504408-project-member Apr 19 08:03:19 user devstack@n-api.service[61209]: method: > Apr 19 08:03:19 user devstack@n-api.service[61209]: exception: Instance 729daf9c-359b-41f7-a15a-6460beab58c8 could not be found. Apr 19 08:03:19 user devstack@n-api.service[61209]: action_args: {'id': '729daf9c-359b-41f7-a15a-6460beab58c8'} Apr 19 08:03:19 user devstack@n-api.service[61209]: {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 729daf9c-359b-41f7-a15a-6460beab58c8 could not be found. Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 729daf9c-359b-41f7-a15a-6460beab58c8 could not be found. Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 729daf9c-359b-41f7-a15a-6460beab58c8 could not be found. Apr 19 08:03:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:03:19 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-56ccc6b2-9386-4909-9697-086d97116e79 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Returning 404 to user: Instance 729daf9c-359b-41f7-a15a-6460beab58c8 could not be found. {{(pid=61209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:03:19 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-56ccc6b2-9386-4909-9697-086d97116e79 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] 10.0.0.210 "GET /compute/v2.1/servers/729daf9c-359b-41f7-a15a-6460beab58c8" status: 404 len: 111 microversion: 2.1 time: 0.042896 Apr 19 08:03:19 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 59/177] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:03:19 2023] GET /compute/v2.1/servers/729daf9c-359b-41f7-a15a-6460beab58c8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:03:19 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=2 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:03:19 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell0:SELECT=4 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:03:19 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:03:19 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-5336dd6c-7290-4acb-afc6-15b5347777ae tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Calling method '.version_select at 0x7f2c026f7400>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:19 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-5336dd6c-7290-4acb-afc6-15b5347777ae tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1575776456" status: 202 len: 0 microversion: 2.1 time: 0.028431 Apr 19 08:03:19 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 60/178] 10.0.0.210 () {62 vars in 1349 bytes} [Wed Apr 19 08:03:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1575776456 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 08:03:21 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=4 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:03:21 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:03:21 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-bb1f06c7-9f6f-40ac-96ae-ad5e1c515a66 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Action: 'create', calling method: .version_select at 0x7f2c00f4f490>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2114188020", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJlaCl4MpsuHHHgLQ6ezsMgQ1V2G9yN1BeqeWrZDg13nYOHJACoReBLfrQFB3FFhE9jOkWadPIx72oo4TZ1ObeVfUE20KrktB0g/mQsMAJOIdG5GpF1dkfeum2u6SDTMw=="}} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:03:21 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-bb1f06c7-9f6f-40ac-96ae-ad5e1c515a66 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Getting quotas for project d5e8362c8d404717b2fa6e510f1de07a. Resources: {'key_pairs'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:03:21 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-bb1f06c7-9f6f-40ac-96ae-ad5e1c515a66 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Getting quotas for user 3d32cbfb3d854d56ad3961da3f406e77 and project d5e8362c8d404717b2fa6e510f1de07a. Resources: {'key_pairs'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:03:21 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-bb1f06c7-9f6f-40ac-96ae-ad5e1c515a66 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.060017 Apr 19 08:03:21 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 60/179] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 08:03:21 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:03:21 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-bc4559ce-54bd-4a8f-9c10-cf6d85eb733a tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2101208858", "imageRef": "36f5e535-7332-453b-888c-a2516e57c84e", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-2114188020", "networks": [{"uuid": "682c6652-a138-4959-89c2-44eddbd9e65c"}]}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:03:21 user devstack@n-api.service[61209]: DEBUG nova.network.neutron [None req-bc4559ce-54bd-4a8f-9c10-cf6d85eb733a tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] validate_networks() for [('682c6652-a138-4959-89c2-44eddbd9e65c', None, None, None, None, None)] {{(pid=61209) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 08:03:23 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-bc4559ce-54bd-4a8f-9c10-cf6d85eb733a tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Flavor limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 08:03:23 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-bc4559ce-54bd-4a8f-9c10-cf6d85eb733a tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Image limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 08:03:23 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-bc4559ce-54bd-4a8f-9c10-cf6d85eb733a tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Flavor pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 08:03:23 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-bc4559ce-54bd-4a8f-9c10-cf6d85eb733a tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Image pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 08:03:23 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-bc4559ce-54bd-4a8f-9c10-cf6d85eb733a tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 08:03:23 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-bc4559ce-54bd-4a8f-9c10-cf6d85eb733a tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:23 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-bc4559ce-54bd-4a8f-9c10-cf6d85eb733a tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:23 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-bc4559ce-54bd-4a8f-9c10-cf6d85eb733a tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:23 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-bc4559ce-54bd-4a8f-9c10-cf6d85eb733a tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:23 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-bc4559ce-54bd-4a8f-9c10-cf6d85eb733a tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:23 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-bc4559ce-54bd-4a8f-9c10-cf6d85eb733a tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:23 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-bc4559ce-54bd-4a8f-9c10-cf6d85eb733a tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Getting quotas for project d5e8362c8d404717b2fa6e510f1de07a. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:03:23 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-bc4559ce-54bd-4a8f-9c10-cf6d85eb733a tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Getting quotas for user 3d32cbfb3d854d56ad3961da3f406e77 and project d5e8362c8d404717b2fa6e510f1de07a. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:03:23 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-bc4559ce-54bd-4a8f-9c10-cf6d85eb733a tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Going to run 1 instances... {{(pid=61209) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 08:03:23 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-bc4559ce-54bd-4a8f-9c10-cf6d85eb733a tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] [instance: 02f0e5d6-1c4e-4549-8991-9dfcea958ac2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='36f5e535-7332-453b-888c-a2516e57c84e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 08:03:23 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-bc4559ce-54bd-4a8f-9c10-cf6d85eb733a tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.388104 Apr 19 08:03:23 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 60/180] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 08:03:21 2023] POST /compute/v2.1/servers => generated 378 bytes in 1390 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 08:03:23 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-10296125-24fc-49c2-afe3-51a1d303e9c3 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:23 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-10296125-24fc-49c2-afe3-51a1d303e9c3 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] [instance: 02f0e5d6-1c4e-4549-8991-9dfcea958ac2] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:03:23 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-10296125-24fc-49c2-afe3-51a1d303e9c3 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32cbfb3d854d56ad3961da3f406e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8362c8d404717b2fa6e510f1de07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:03:23 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-10296125-24fc-49c2-afe3-51a1d303e9c3 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02f0e5d6-1c4e-4549-8991-9dfcea958ac2" status: 200 len: 1253 microversion: 2.1 time: 0.080872 Apr 19 08:03:23 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 61/181] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:03:23 2023] GET /compute/v2.1/servers/02f0e5d6-1c4e-4549-8991-9dfcea958ac2 => generated 1253 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 08:03:26 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-5d3b542a-2915-4043-ab77-e64f641c6f59 req-41e3dc59-0d1f-4c57-a60a-4c64351aeca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02f0e5d6-1c4e-4549-8991-9dfcea958ac2", "tag": "56567141-0a44-48a8-9388-4f4804539616"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:03:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-5d3b542a-2915-4043-ab77-e64f641c6f59 req-41e3dc59-0d1f-4c57-a60a-4c64351aeca8 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-5d3b542a-2915-4043-ab77-e64f641c6f59 req-41e3dc59-0d1f-4c57-a60a-4c64351aeca8 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-5d3b542a-2915-4043-ab77-e64f641c6f59 req-41e3dc59-0d1f-4c57-a60a-4c64351aeca8 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:26 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-5d3b542a-2915-4043-ab77-e64f641c6f59 req-41e3dc59-0d1f-4c57-a60a-4c64351aeca8 service nova] Creating event network-changed:56567141-0a44-48a8-9388-4f4804539616 for instance 02f0e5d6-1c4e-4549-8991-9dfcea958ac2 on user Apr 19 08:03:26 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-5d3b542a-2915-4043-ab77-e64f641c6f59 req-41e3dc59-0d1f-4c57-a60a-4c64351aeca8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038226 Apr 19 08:03:26 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 61/182] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:03:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:03:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-b5dc8644-62f1-4a04-ba31-fd5b928253bf tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:27 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-b5dc8644-62f1-4a04-ba31-fd5b928253bf tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] [instance: 5eb02260-a7ea-4b05-8d8d-72950cfce57b] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:03:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b5dc8644-62f1-4a04-ba31-fd5b928253bf tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b5dc8644-62f1-4a04-ba31-fd5b928253bf tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b5dc8644-62f1-4a04-ba31-fd5b928253bf tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b5dc8644-62f1-4a04-ba31-fd5b928253bf tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b5dc8644-62f1-4a04-ba31-fd5b928253bf tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b5dc8644-62f1-4a04-ba31-fd5b928253bf tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:27 user devstack@n-api.service[61209]: INFO nova.api.openstack.wsgi [None req-b5dc8644-62f1-4a04-ba31-fd5b928253bf tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] HTTP exception thrown: Instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b could not be found. Apr 19 08:03:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-b5dc8644-62f1-4a04-ba31-fd5b928253bf tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Request method failure captured: Apr 19 08:03:27 user devstack@n-api.service[61209]: request: GET /compute/v2.1/servers/5eb02260-a7ea-4b05-8d8d-72950cfce57b HTTP/1.1 Apr 19 08:03:27 user devstack@n-api.service[61209]: Accept: application/json Apr 19 08:03:27 user devstack@n-api.service[61209]: Accept-Encoding: identity Apr 19 08:03:27 user devstack@n-api.service[61209]: Connection: close Apr 19 08:03:27 user devstack@n-api.service[61209]: Content-Length: 0 Apr 19 08:03:27 user devstack@n-api.service[61209]: Content-Type: application/json Apr 19 08:03:27 user devstack@n-api.service[61209]: Host: 10.0.0.210 Apr 19 08:03:27 user devstack@n-api.service[61209]: Openstack-System-Scope: None Apr 19 08:03:27 user devstack@n-api.service[61209]: User-Agent: python-urllib3/1.26.15 Apr 19 08:03:27 user devstack@n-api.service[61209]: X-Auth-Token: gAAAAABkP5-oBRyQ4BeGi1AfbuX6Mloui33X0j1PxzbJ9i9bpcOAKFC-5ZEqiUTdlSV10jcIcUhYWWEV1suV_WhBEJEsBi4w928lQW3Bmlkl0BqHtK3dowcF7w_bL3qorWgr_I08Quls8HQKXBKGo3ryaJWi5NT1726epHv00d3iAyKQXphgHCE Apr 19 08:03:27 user devstack@n-api.service[61209]: X-Domain-Id: None Apr 19 08:03:27 user devstack@n-api.service[61209]: X-Domain-Name: None Apr 19 08:03:27 user devstack@n-api.service[61209]: X-Identity-Status: Confirmed Apr 19 08:03:27 user devstack@n-api.service[61209]: X-Is-Admin-Project: True Apr 19 08:03:27 user devstack@n-api.service[61209]: X-Project-Domain-Id: default Apr 19 08:03:27 user devstack@n-api.service[61209]: X-Project-Domain-Name: Default Apr 19 08:03:27 user devstack@n-api.service[61209]: X-Project-Id: 8d73100ea55541d08952a24ef6931a0a Apr 19 08:03:27 user devstack@n-api.service[61209]: X-Project-Name: tempest-AttachVolumeTestJSON-718709395 Apr 19 08:03:27 user devstack@n-api.service[61209]: X-Role: reader,member Apr 19 08:03:27 user devstack@n-api.service[61209]: X-Roles: reader,member Apr 19 08:03:27 user devstack@n-api.service[61209]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d73100ea55541d08952a24ef6931a0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d73100ea55541d08952a24ef6931a0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d73100ea55541d08952a24ef6931a0a"}]}] Apr 19 08:03:27 user devstack@n-api.service[61209]: X-Tenant: tempest-AttachVolumeTestJSON-718709395 Apr 19 08:03:27 user devstack@n-api.service[61209]: X-Tenant-Id: 8d73100ea55541d08952a24ef6931a0a Apr 19 08:03:27 user devstack@n-api.service[61209]: X-Tenant-Name: tempest-AttachVolumeTestJSON-718709395 Apr 19 08:03:27 user devstack@n-api.service[61209]: X-User: tempest-AttachVolumeTestJSON-718709395-project-member Apr 19 08:03:27 user devstack@n-api.service[61209]: X-User-Domain-Id: default Apr 19 08:03:27 user devstack@n-api.service[61209]: X-User-Domain-Name: Default Apr 19 08:03:27 user devstack@n-api.service[61209]: X-User-Id: 64f18935b0524876bf69f22cff03139a Apr 19 08:03:27 user devstack@n-api.service[61209]: X-User-Name: tempest-AttachVolumeTestJSON-718709395-project-member Apr 19 08:03:27 user devstack@n-api.service[61209]: method: > Apr 19 08:03:27 user devstack@n-api.service[61209]: exception: Instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b could not be found. Apr 19 08:03:27 user devstack@n-api.service[61209]: action_args: {'id': '5eb02260-a7ea-4b05-8d8d-72950cfce57b'} Apr 19 08:03:27 user devstack@n-api.service[61209]: {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b could not be found. Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b could not be found. Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b could not be found. Apr 19 08:03:27 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:03:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-b5dc8644-62f1-4a04-ba31-fd5b928253bf tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Returning 404 to user: Instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b could not be found. {{(pid=61209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:03:27 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-b5dc8644-62f1-4a04-ba31-fd5b928253bf tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5eb02260-a7ea-4b05-8d8d-72950cfce57b" status: 404 len: 111 microversion: 2.1 time: 0.029975 Apr 19 08:03:27 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 61/183] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:03:27 2023] GET /compute/v2.1/servers/5eb02260-a7ea-4b05-8d8d-72950cfce57b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:03:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-70e10c59-7651-4cd8-a27f-a77ffd89a282 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Calling method '.version_select at 0x7f2c01050550>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:27 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-70e10c59-7651-4cd8-a27f-a77ffd89a282 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1494237566" status: 202 len: 0 microversion: 2.1 time: 0.025417 Apr 19 08:03:27 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 62/184] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 08:03:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1494237566 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 08:03:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-7e7b2ce5-c186-4bc6-8f02-3bd313484a96 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:27 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-7e7b2ce5-c186-4bc6-8f02-3bd313484a96 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] [instance: bdeeb437-76a3-49b5-9553-d2da74917d69] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:03:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7e7b2ce5-c186-4bc6-8f02-3bd313484a96 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7e7b2ce5-c186-4bc6-8f02-3bd313484a96 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7e7b2ce5-c186-4bc6-8f02-3bd313484a96 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7e7b2ce5-c186-4bc6-8f02-3bd313484a96 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7e7b2ce5-c186-4bc6-8f02-3bd313484a96 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7e7b2ce5-c186-4bc6-8f02-3bd313484a96 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:28 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-7e7b2ce5-c186-4bc6-8f02-3bd313484a96 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dc2a88f2d149a1a4035ed1c7e74b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcde8c2a3444e919d232ea854c00e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:03:28 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-7e7b2ce5-c186-4bc6-8f02-3bd313484a96 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69" status: 200 len: 1658 microversion: 2.1 time: 0.344484 Apr 19 08:03:28 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 62/185] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:03:27 2023] GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69 => generated 1658 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:03:28 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-c1a6c71c-188c-41df-8b3e-118ee330a67e tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:28 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-c1a6c71c-188c-41df-8b3e-118ee330a67e tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] [instance: bdeeb437-76a3-49b5-9553-d2da74917d69] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:03:28 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c1a6c71c-188c-41df-8b3e-118ee330a67e tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:28 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c1a6c71c-188c-41df-8b3e-118ee330a67e tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:28 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c1a6c71c-188c-41df-8b3e-118ee330a67e tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:28 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c1a6c71c-188c-41df-8b3e-118ee330a67e tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:28 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c1a6c71c-188c-41df-8b3e-118ee330a67e tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:28 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c1a6c71c-188c-41df-8b3e-118ee330a67e tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:28 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-d8ccbc49-04ff-460b-b005-49d333ae4f96 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Action: 'create', calling method: .version_select at 0x7f2c01052ef0>, body: {"keypair": {"name": "tempest-keypair-2037294831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkZbfQbfAptpELN9vQXgtFXMdsMhSDaimIfC5FwYDNrXD6dFkuwli4Hi/q2LUm5eEWK1FnYs6iSZAYrhy5hwUW7oSH4/Rw+qjbn9YDVjAzfGyYm7aJGW1WuZR2K2ZiQpg=="}} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:03:28 user devstack@n-api.service[61210]: DEBUG nova.quota [None req-d8ccbc49-04ff-460b-b005-49d333ae4f96 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Getting quotas for project 8d73100ea55541d08952a24ef6931a0a. Resources: {'key_pairs'} {{(pid=61210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:03:28 user devstack@n-api.service[61210]: DEBUG nova.quota [None req-d8ccbc49-04ff-460b-b005-49d333ae4f96 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Getting quotas for user 64f18935b0524876bf69f22cff03139a and project 8d73100ea55541d08952a24ef6931a0a. Resources: {'key_pairs'} {{(pid=61210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:03:28 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-d8ccbc49-04ff-460b-b005-49d333ae4f96 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045166 Apr 19 08:03:28 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 63/186] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 08:03:28 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:03:28 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-c1a6c71c-188c-41df-8b3e-118ee330a67e tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dc2a88f2d149a1a4035ed1c7e74b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcde8c2a3444e919d232ea854c00e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:03:28 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-c1a6c71c-188c-41df-8b3e-118ee330a67e tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69" status: 200 len: 1658 microversion: 2.1 time: 0.425635 Apr 19 08:03:28 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 62/187] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:03:28 2023] GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69 => generated 1658 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:03:28 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-93cf6e5f-0cd0-4067-b52e-f9f82f038b23 req-43bf97d4-7e97-46c5-8ad6-07e310784095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f0e5d6-1c4e-4549-8991-9dfcea958ac2", "name": "network-vif-plugged", "status": "completed", "tag": "56567141-0a44-48a8-9388-4f4804539616"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:03:28 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-93cf6e5f-0cd0-4067-b52e-f9f82f038b23 req-43bf97d4-7e97-46c5-8ad6-07e310784095 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:28 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-93cf6e5f-0cd0-4067-b52e-f9f82f038b23 req-43bf97d4-7e97-46c5-8ad6-07e310784095 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:28 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-93cf6e5f-0cd0-4067-b52e-f9f82f038b23 req-43bf97d4-7e97-46c5-8ad6-07e310784095 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:28 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-93cf6e5f-0cd0-4067-b52e-f9f82f038b23 req-43bf97d4-7e97-46c5-8ad6-07e310784095 service nova] Creating event network-vif-plugged:56567141-0a44-48a8-9388-4f4804539616 for instance 02f0e5d6-1c4e-4549-8991-9dfcea958ac2 on user Apr 19 08:03:28 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-93cf6e5f-0cd0-4067-b52e-f9f82f038b23 req-43bf97d4-7e97-46c5-8ad6-07e310784095 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029720 Apr 19 08:03:28 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 63/188] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:03:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:03:30 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-9eb19cd5-b208-4c82-b96f-22b90e635722 req-7f026bb7-b777-4163-a363-39b1c0fdb4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f0e5d6-1c4e-4549-8991-9dfcea958ac2", "name": "network-vif-plugged", "status": "completed", "tag": "56567141-0a44-48a8-9388-4f4804539616"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:03:30 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-9eb19cd5-b208-4c82-b96f-22b90e635722 req-7f026bb7-b777-4163-a363-39b1c0fdb4c0 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:30 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-9eb19cd5-b208-4c82-b96f-22b90e635722 req-7f026bb7-b777-4163-a363-39b1c0fdb4c0 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:30 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-9eb19cd5-b208-4c82-b96f-22b90e635722 req-7f026bb7-b777-4163-a363-39b1c0fdb4c0 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:30 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-9eb19cd5-b208-4c82-b96f-22b90e635722 req-7f026bb7-b777-4163-a363-39b1c0fdb4c0 service nova] Creating event network-vif-plugged:56567141-0a44-48a8-9388-4f4804539616 for instance 02f0e5d6-1c4e-4549-8991-9dfcea958ac2 on user Apr 19 08:03:30 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-9eb19cd5-b208-4c82-b96f-22b90e635722 req-7f026bb7-b777-4163-a363-39b1c0fdb4c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034196 Apr 19 08:03:30 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 64/189] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:03:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 08:03:31 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-2ac982d0-a304-4202-94d1-8ff0df4ee0f9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2010064754", "imageRef": "b515545f-3b22-4d80-a102-6a318ab9717a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ecb38694-e852-4967-af2b-2b034921cae2"}], "security_groups": [{"name": "tempest-securitygroup--1809172875"}], "key_name": "tempest-keypair-2037294831", "user_data": "}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:03:31 user devstack@n-api.service[61209]: DEBUG nova.network.neutron [None req-2ac982d0-a304-4202-94d1-8ff0df4ee0f9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] validate_networks() for [('ecb38694-e852-4967-af2b-2b034921cae2', None, None, None, None, None)] {{(pid=61209) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 08:03:31 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-de7f8a9c-cb16-4be4-8a61-be4b2308cc10 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:31 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-de7f8a9c-cb16-4be4-8a61-be4b2308cc10 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] [instance: f3504e30-9be0-40b5-a53c-859dadad53a1] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:03:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-de7f8a9c-cb16-4be4-8a61-be4b2308cc10 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-de7f8a9c-cb16-4be4-8a61-be4b2308cc10 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-de7f8a9c-cb16-4be4-8a61-be4b2308cc10 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-de7f8a9c-cb16-4be4-8a61-be4b2308cc10 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-de7f8a9c-cb16-4be4-8a61-be4b2308cc10 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-de7f8a9c-cb16-4be4-8a61-be4b2308cc10 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:31 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=4 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:03:31 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-de7f8a9c-cb16-4be4-8a61-be4b2308cc10 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9796d2c200d4419b0fe67d541efc8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173f7e00d8f748debe5a126203220f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:03:31 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-de7f8a9c-cb16-4be4-8a61-be4b2308cc10 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3504e30-9be0-40b5-a53c-859dadad53a1" status: 200 len: 1503 microversion: 2.1 time: 0.298790 Apr 19 08:03:31 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 64/190] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:03:31 2023] GET /compute/v2.1/servers/f3504e30-9be0-40b5-a53c-859dadad53a1 => generated 1503 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:03:32 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-2ac982d0-a304-4202-94d1-8ff0df4ee0f9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Flavor limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 08:03:32 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-2ac982d0-a304-4202-94d1-8ff0df4ee0f9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Image limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 08:03:32 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-2ac982d0-a304-4202-94d1-8ff0df4ee0f9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Flavor pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 08:03:32 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-2ac982d0-a304-4202-94d1-8ff0df4ee0f9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Image pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 08:03:32 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-2ac982d0-a304-4202-94d1-8ff0df4ee0f9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 08:03:32 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-2ac982d0-a304-4202-94d1-8ff0df4ee0f9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:32 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-2ac982d0-a304-4202-94d1-8ff0df4ee0f9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:32 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-2ac982d0-a304-4202-94d1-8ff0df4ee0f9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:32 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-2ac982d0-a304-4202-94d1-8ff0df4ee0f9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:32 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-2ac982d0-a304-4202-94d1-8ff0df4ee0f9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:32 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-2ac982d0-a304-4202-94d1-8ff0df4ee0f9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:32 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-2ac982d0-a304-4202-94d1-8ff0df4ee0f9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Getting quotas for project 8d73100ea55541d08952a24ef6931a0a. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:03:32 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-2ac982d0-a304-4202-94d1-8ff0df4ee0f9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Getting quotas for user 64f18935b0524876bf69f22cff03139a and project 8d73100ea55541d08952a24ef6931a0a. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:03:32 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-2ac982d0-a304-4202-94d1-8ff0df4ee0f9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Going to run 1 instances... {{(pid=61209) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 08:03:32 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-2ac982d0-a304-4202-94d1-8ff0df4ee0f9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] [instance: 2aa7cbc5-8b78-4631-a906-af3b4a63570a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b515545f-3b22-4d80-a102-6a318ab9717a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 08:03:32 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-2ac982d0-a304-4202-94d1-8ff0df4ee0f9 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.905035 Apr 19 08:03:32 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 63/191] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 08:03:31 2023] POST /compute/v2.1/servers => generated 400 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 08:03:32 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-cfc01238-aa4f-4e44-8748-84b11d7bca3c tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:32 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-cfc01238-aa4f-4e44-8748-84b11d7bca3c tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] [instance: 2aa7cbc5-8b78-4631-a906-af3b4a63570a] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:03:32 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-cfc01238-aa4f-4e44-8748-84b11d7bca3c tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f18935b0524876bf69f22cff03139a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d73100ea55541d08952a24ef6931a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:03:32 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-cfc01238-aa4f-4e44-8748-84b11d7bca3c tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aa7cbc5-8b78-4631-a906-af3b4a63570a" status: 200 len: 1232 microversion: 2.1 time: 0.104028 Apr 19 08:03:32 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 65/192] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:03:32 2023] GET /compute/v2.1/servers/2aa7cbc5-8b78-4631-a906-af3b4a63570a => generated 1232 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 08:03:32 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-0e19db2b-2acb-45a0-9fdf-c08c292d89dc tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Action: 'create', calling method: .version_select at 0x7f2c00f4e8c0>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1853359407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSw3MDG3XO8phWiQz9zyDY7p0USzUJtoNfLYYZiPwr83HqaBNGhok3oa1lmtR9b/GbnT4LR9L/wdDAfa/s08dNSByWWF3xpNl8yseHKrJw6JlBkMA5txDTCcw9pp/bvkw=="}} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:03:32 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-0e19db2b-2acb-45a0-9fdf-c08c292d89dc tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Getting quotas for project e5e7f06d44ee43138f373093d40014fa. Resources: {'key_pairs'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:03:32 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-0e19db2b-2acb-45a0-9fdf-c08c292d89dc tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Getting quotas for user 8043565b02bb4f63b4a0b552b7191098 and project e5e7f06d44ee43138f373093d40014fa. Resources: {'key_pairs'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:03:32 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-0e19db2b-2acb-45a0-9fdf-c08c292d89dc tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.243337 Apr 19 08:03:32 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 65/193] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 08:03:32 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:03:34 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-507795a5-3863-45de-938d-a128cff03bd9 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1881354562", "imageRef": "b515545f-3b22-4d80-a102-6a318ab9717a", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1853359407", "security_groups": [{"name": "tempest-secgroup-smoke-1603986221"}], "networks": [{"uuid": "54d71409-476d-4563-9e39-b347b5127f0e"}]}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:03:34 user devstack@n-api.service[61209]: DEBUG nova.network.neutron [None req-507795a5-3863-45de-938d-a128cff03bd9 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] validate_networks() for [('54d71409-476d-4563-9e39-b347b5127f0e', None, None, None, None, None)] {{(pid=61209) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 08:03:34 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-507795a5-3863-45de-938d-a128cff03bd9 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Flavor limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 08:03:34 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-507795a5-3863-45de-938d-a128cff03bd9 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Image limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 08:03:34 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-507795a5-3863-45de-938d-a128cff03bd9 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Flavor pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 08:03:34 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-507795a5-3863-45de-938d-a128cff03bd9 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Image pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 08:03:34 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-507795a5-3863-45de-938d-a128cff03bd9 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 08:03:34 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-507795a5-3863-45de-938d-a128cff03bd9 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:34 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-507795a5-3863-45de-938d-a128cff03bd9 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:34 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-507795a5-3863-45de-938d-a128cff03bd9 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:34 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-507795a5-3863-45de-938d-a128cff03bd9 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:34 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-507795a5-3863-45de-938d-a128cff03bd9 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:34 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-507795a5-3863-45de-938d-a128cff03bd9 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:34 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-507795a5-3863-45de-938d-a128cff03bd9 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Getting quotas for project e5e7f06d44ee43138f373093d40014fa. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:03:34 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-507795a5-3863-45de-938d-a128cff03bd9 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Getting quotas for user 8043565b02bb4f63b4a0b552b7191098 and project e5e7f06d44ee43138f373093d40014fa. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:03:34 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-507795a5-3863-45de-938d-a128cff03bd9 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Going to run 1 instances... {{(pid=61209) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 08:03:34 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-507795a5-3863-45de-938d-a128cff03bd9 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] [instance: bb5de453-e849-4495-8e25-6d3b0e8c3569] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b515545f-3b22-4d80-a102-6a318ab9717a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 08:03:34 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-e752bbe8-b047-4e68-8446-c765eb6e643f req-6cfbeef8-7d38-449e-aad2-66920abc568f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa7cbc5-8b78-4631-a906-af3b4a63570a", "tag": "0791bbd2-9560-4bb3-8689-76793f8ac5c0"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:03:34 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-e752bbe8-b047-4e68-8446-c765eb6e643f req-6cfbeef8-7d38-449e-aad2-66920abc568f service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:34 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-e752bbe8-b047-4e68-8446-c765eb6e643f req-6cfbeef8-7d38-449e-aad2-66920abc568f service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:34 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-e752bbe8-b047-4e68-8446-c765eb6e643f req-6cfbeef8-7d38-449e-aad2-66920abc568f service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:35 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-e752bbe8-b047-4e68-8446-c765eb6e643f req-6cfbeef8-7d38-449e-aad2-66920abc568f service nova] Creating event network-changed:0791bbd2-9560-4bb3-8689-76793f8ac5c0 for instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a on user Apr 19 08:03:35 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-e752bbe8-b047-4e68-8446-c765eb6e643f req-6cfbeef8-7d38-449e-aad2-66920abc568f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029489 Apr 19 08:03:35 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 66/194] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:03:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:03:35 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-507795a5-3863-45de-938d-a128cff03bd9 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.770995 Apr 19 08:03:35 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 64/195] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 08:03:34 2023] POST /compute/v2.1/servers => generated 404 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 08:03:35 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-92dd748d-5ece-47b7-aaaa-d7c023783e6e tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:35 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-92dd748d-5ece-47b7-aaaa-d7c023783e6e tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] [instance: bb5de453-e849-4495-8e25-6d3b0e8c3569] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:03:35 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-92dd748d-5ece-47b7-aaaa-d7c023783e6e tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8043565b02bb4f63b4a0b552b7191098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f06d44ee43138f373093d40014fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:03:35 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-92dd748d-5ece-47b7-aaaa-d7c023783e6e tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb5de453-e849-4495-8e25-6d3b0e8c3569" status: 200 len: 1257 microversion: 2.1 time: 0.073606 Apr 19 08:03:35 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 66/196] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:03:35 2023] GET /compute/v2.1/servers/bb5de453-e849-4495-8e25-6d3b0e8c3569 => generated 1257 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:03:37 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-05ec20ca-2322-4f9c-a258-7111f3e7f772 req-c8c0a1e5-1358-4b86-8b3f-0a8cc954ff1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa7cbc5-8b78-4631-a906-af3b4a63570a", "name": "network-vif-plugged", "status": "completed", "tag": "0791bbd2-9560-4bb3-8689-76793f8ac5c0"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:03:37 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-05ec20ca-2322-4f9c-a258-7111f3e7f772 req-c8c0a1e5-1358-4b86-8b3f-0a8cc954ff1d service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:37 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-05ec20ca-2322-4f9c-a258-7111f3e7f772 req-c8c0a1e5-1358-4b86-8b3f-0a8cc954ff1d service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:37 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-05ec20ca-2322-4f9c-a258-7111f3e7f772 req-c8c0a1e5-1358-4b86-8b3f-0a8cc954ff1d service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:37 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-05ec20ca-2322-4f9c-a258-7111f3e7f772 req-c8c0a1e5-1358-4b86-8b3f-0a8cc954ff1d service nova] Creating event network-vif-plugged:0791bbd2-9560-4bb3-8689-76793f8ac5c0 for instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a on user Apr 19 08:03:37 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-05ec20ca-2322-4f9c-a258-7111f3e7f772 req-c8c0a1e5-1358-4b86-8b3f-0a8cc954ff1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033718 Apr 19 08:03:37 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 67/197] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:03:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:03:37 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-5d4195cc-7b34-43bb-9e3e-82bd0858c1e0 tempest-VolumesGetTestJSON-1198273019 tempest-VolumesGetTestJSON-1198273019-project-member] Action: 'create', calling method: .version_select at 0x7f2c01b8b910>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-415150176", "metadata": {"Type": "work"}}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:03:37 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-5d4195cc-7b34-43bb-9e3e-82bd0858c1e0 tempest-VolumesGetTestJSON-1198273019 tempest-VolumesGetTestJSON-1198273019-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.485106 Apr 19 08:03:37 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 65/198] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 19 08:03:37 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 487 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 19 08:03:38 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-45bea71f-5f69-4ffe-9ab4-6c19169fa365 tempest-VolumesGetTestJSON-1198273019 tempest-VolumesGetTestJSON-1198273019-project-member] Calling method '.version_select at 0x7f2c00f4dfc0>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:38 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-45bea71f-5f69-4ffe-9ab4-6c19169fa365 tempest-VolumesGetTestJSON-1198273019 tempest-VolumesGetTestJSON-1198273019-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/699d3658-f8f2-42e9-ac9b-49ca9d89f278" status: 200 len: 352 microversion: 2.1 time: 0.055749 Apr 19 08:03:38 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 67/199] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 08:03:37 2023] GET /compute/v2.1/os-volumes/699d3658-f8f2-42e9-ac9b-49ca9d89f278 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:03:38 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-8a812956-e2f9-4ac3-bbab-717cb750cfe9 req-ea96752d-535c-4902-8ca1-e8192b9a4e6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb5de453-e849-4495-8e25-6d3b0e8c3569", "tag": "1f650f36-60e3-4ddb-bb93-facba325d15f"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:03:38 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-8a812956-e2f9-4ac3-bbab-717cb750cfe9 req-ea96752d-535c-4902-8ca1-e8192b9a4e6d service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:38 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-8a812956-e2f9-4ac3-bbab-717cb750cfe9 req-ea96752d-535c-4902-8ca1-e8192b9a4e6d service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:38 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-8a812956-e2f9-4ac3-bbab-717cb750cfe9 req-ea96752d-535c-4902-8ca1-e8192b9a4e6d service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:38 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-8a812956-e2f9-4ac3-bbab-717cb750cfe9 req-ea96752d-535c-4902-8ca1-e8192b9a4e6d service nova] Creating event network-changed:1f650f36-60e3-4ddb-bb93-facba325d15f for instance bb5de453-e849-4495-8e25-6d3b0e8c3569 on user Apr 19 08:03:38 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-8a812956-e2f9-4ac3-bbab-717cb750cfe9 req-ea96752d-535c-4902-8ca1-e8192b9a4e6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048878 Apr 19 08:03:38 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 68/200] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:03:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:03:39 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-18699817-38f0-4e6c-93e5-330943476f38 tempest-VolumesGetTestJSON-1198273019 tempest-VolumesGetTestJSON-1198273019-project-member] Calling method '.version_select at 0x7f2c010ccaf0>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:39 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-18699817-38f0-4e6c-93e5-330943476f38 tempest-VolumesGetTestJSON-1198273019 tempest-VolumesGetTestJSON-1198273019-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/699d3658-f8f2-42e9-ac9b-49ca9d89f278" status: 200 len: 349 microversion: 2.1 time: 0.047986 Apr 19 08:03:39 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 66/201] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 08:03:39 2023] GET /compute/v2.1/os-volumes/699d3658-f8f2-42e9-ac9b-49ca9d89f278 => generated 349 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:03:39 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-d471fc17-aa92-4dfa-a9e5-9312cd17b458 tempest-VolumesGetTestJSON-1198273019 tempest-VolumesGetTestJSON-1198273019-project-member] Calling method '.version_select at 0x7f2c00f4e320>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:39 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-d471fc17-aa92-4dfa-a9e5-9312cd17b458 tempest-VolumesGetTestJSON-1198273019 tempest-VolumesGetTestJSON-1198273019-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/699d3658-f8f2-42e9-ac9b-49ca9d89f278" status: 202 len: 0 microversion: 2.1 time: 0.118425 Apr 19 08:03:39 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 68/202] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 08:03:39 2023] DELETE /compute/v2.1/os-volumes/699d3658-f8f2-42e9-ac9b-49ca9d89f278 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 08:03:39 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-a9b8cec8-af49-434a-92ba-67882543b106 tempest-VolumesGetTestJSON-1198273019 tempest-VolumesGetTestJSON-1198273019-project-member] Calling method '.version_select at 0x7f2c011f2560>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:39 user devstack@n-api.service[61210]: INFO nova.api.openstack.wsgi [None req-a9b8cec8-af49-434a-92ba-67882543b106 tempest-VolumesGetTestJSON-1198273019 tempest-VolumesGetTestJSON-1198273019-project-member] HTTP exception thrown: Volume 699d3658-f8f2-42e9-ac9b-49ca9d89f278 could not be found. Apr 19 08:03:39 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-a9b8cec8-af49-434a-92ba-67882543b106 tempest-VolumesGetTestJSON-1198273019 tempest-VolumesGetTestJSON-1198273019-project-member] Request method failure captured: Apr 19 08:03:39 user devstack@n-api.service[61210]: request: GET /compute/v2.1/os-volumes/699d3658-f8f2-42e9-ac9b-49ca9d89f278 HTTP/1.1 Apr 19 08:03:39 user devstack@n-api.service[61210]: Accept: application/json Apr 19 08:03:39 user devstack@n-api.service[61210]: Accept-Encoding: identity Apr 19 08:03:39 user devstack@n-api.service[61210]: Connection: close Apr 19 08:03:39 user devstack@n-api.service[61210]: Content-Length: 0 Apr 19 08:03:39 user devstack@n-api.service[61210]: Content-Type: application/json Apr 19 08:03:39 user devstack@n-api.service[61210]: Host: 10.0.0.210 Apr 19 08:03:39 user devstack@n-api.service[61210]: Openstack-System-Scope: None Apr 19 08:03:39 user devstack@n-api.service[61210]: User-Agent: python-urllib3/1.26.15 Apr 19 08:03:39 user devstack@n-api.service[61210]: X-Auth-Token: gAAAAABkP6BZ5JWsYMvnwRod8nOocxQcW8E0IKDvdSqjw54jRlaoPcJaDcQgDdQRTCBZYJ6WWbrZlJB4jcLHYLXnnQ7mMmxB5HNssEWHIeQ_6vfdt5ARcygsIWxAlz7F4WPH857O5s5qsgT-B99NB40vujdvxLxtjf4r6y_A3JoZ_IYUXXwQbNE Apr 19 08:03:39 user devstack@n-api.service[61210]: X-Domain-Id: None Apr 19 08:03:39 user devstack@n-api.service[61210]: X-Domain-Name: None Apr 19 08:03:39 user devstack@n-api.service[61210]: X-Identity-Status: Confirmed Apr 19 08:03:39 user devstack@n-api.service[61210]: X-Is-Admin-Project: True Apr 19 08:03:39 user devstack@n-api.service[61210]: X-Project-Domain-Id: default Apr 19 08:03:39 user devstack@n-api.service[61210]: X-Project-Domain-Name: Default Apr 19 08:03:39 user devstack@n-api.service[61210]: X-Project-Id: 37a6bcbec25c463a9ceafa0bd6109ef0 Apr 19 08:03:39 user devstack@n-api.service[61210]: X-Project-Name: tempest-VolumesGetTestJSON-1198273019 Apr 19 08:03:39 user devstack@n-api.service[61210]: X-Role: reader,member Apr 19 08:03:39 user devstack@n-api.service[61210]: X-Roles: reader,member Apr 19 08:03:39 user devstack@n-api.service[61210]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37a6bcbec25c463a9ceafa0bd6109ef0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/37a6bcbec25c463a9ceafa0bd6109ef0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/37a6bcbec25c463a9ceafa0bd6109ef0"}]}] Apr 19 08:03:39 user devstack@n-api.service[61210]: X-Tenant: tempest-VolumesGetTestJSON-1198273019 Apr 19 08:03:39 user devstack@n-api.service[61210]: X-Tenant-Id: 37a6bcbec25c463a9ceafa0bd6109ef0 Apr 19 08:03:39 user devstack@n-api.service[61210]: X-Tenant-Name: tempest-VolumesGetTestJSON-1198273019 Apr 19 08:03:39 user devstack@n-api.service[61210]: X-User: tempest-VolumesGetTestJSON-1198273019-project-member Apr 19 08:03:39 user devstack@n-api.service[61210]: X-User-Domain-Id: default Apr 19 08:03:39 user devstack@n-api.service[61210]: X-User-Domain-Name: Default Apr 19 08:03:39 user devstack@n-api.service[61210]: X-User-Id: 97e83213a8a246ee941377452407b89a Apr 19 08:03:39 user devstack@n-api.service[61210]: X-User-Name: tempest-VolumesGetTestJSON-1198273019-project-member Apr 19 08:03:39 user devstack@n-api.service[61210]: method: Apr 19 08:03:39 user devstack@n-api.service[61210]: exception: Volume 699d3658-f8f2-42e9-ac9b-49ca9d89f278 could not be found. Apr 19 08:03:39 user devstack@n-api.service[61210]: action_args: {'id': '699d3658-f8f2-42e9-ac9b-49ca9d89f278'} Apr 19 08:03:39 user devstack@n-api.service[61210]: {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 699d3658-f8f2-42e9-ac9b-49ca9d89f278 could not be found. (HTTP 404) (Request-ID: req-d31b29b8-5620-4cd5-8577-afca4c763264) Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 699d3658-f8f2-42e9-ac9b-49ca9d89f278 could not be found. Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 699d3658-f8f2-42e9-ac9b-49ca9d89f278 could not be found. Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 699d3658-f8f2-42e9-ac9b-49ca9d89f278 could not be found. Apr 19 08:03:39 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:03:39 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-a9b8cec8-af49-434a-92ba-67882543b106 tempest-VolumesGetTestJSON-1198273019 tempest-VolumesGetTestJSON-1198273019-project-member] Returning 404 to user: Volume 699d3658-f8f2-42e9-ac9b-49ca9d89f278 could not be found. {{(pid=61210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:03:39 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-a9b8cec8-af49-434a-92ba-67882543b106 tempest-VolumesGetTestJSON-1198273019 tempest-VolumesGetTestJSON-1198273019-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/699d3658-f8f2-42e9-ac9b-49ca9d89f278" status: 404 len: 109 microversion: 2.1 time: 0.042357 Apr 19 08:03:39 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 69/203] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 19 08:03:39 2023] GET /compute/v2.1/os-volumes/699d3658-f8f2-42e9-ac9b-49ca9d89f278 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:03:39 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-25dcb9ae-83fa-420e-a553-b5fd69757cd1 req-eedfdae9-a40c-4d01-8ac9-d03d36765664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa7cbc5-8b78-4631-a906-af3b4a63570a", "name": "network-vif-plugged", "status": "completed", "tag": "0791bbd2-9560-4bb3-8689-76793f8ac5c0"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:03:39 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-25dcb9ae-83fa-420e-a553-b5fd69757cd1 req-eedfdae9-a40c-4d01-8ac9-d03d36765664 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:39 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-25dcb9ae-83fa-420e-a553-b5fd69757cd1 req-eedfdae9-a40c-4d01-8ac9-d03d36765664 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:39 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-25dcb9ae-83fa-420e-a553-b5fd69757cd1 req-eedfdae9-a40c-4d01-8ac9-d03d36765664 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:39 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-25dcb9ae-83fa-420e-a553-b5fd69757cd1 req-eedfdae9-a40c-4d01-8ac9-d03d36765664 service nova] Creating event network-vif-plugged:0791bbd2-9560-4bb3-8689-76793f8ac5c0 for instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a on user Apr 19 08:03:39 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-25dcb9ae-83fa-420e-a553-b5fd69757cd1 req-eedfdae9-a40c-4d01-8ac9-d03d36765664 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033799 Apr 19 08:03:39 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 67/204] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:03:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:03:40 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-c501fd37-c58d-4ed7-a2f8-881d56c83a1b req-9cfc362a-d11c-4fcb-aaf1-c1cc7165cdc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb5de453-e849-4495-8e25-6d3b0e8c3569", "name": "network-vif-plugged", "status": "completed", "tag": "1f650f36-60e3-4ddb-bb93-facba325d15f"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:03:40 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-c501fd37-c58d-4ed7-a2f8-881d56c83a1b req-9cfc362a-d11c-4fcb-aaf1-c1cc7165cdc5 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:40 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-c501fd37-c58d-4ed7-a2f8-881d56c83a1b req-9cfc362a-d11c-4fcb-aaf1-c1cc7165cdc5 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:40 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-c501fd37-c58d-4ed7-a2f8-881d56c83a1b req-9cfc362a-d11c-4fcb-aaf1-c1cc7165cdc5 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:40 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-c501fd37-c58d-4ed7-a2f8-881d56c83a1b req-9cfc362a-d11c-4fcb-aaf1-c1cc7165cdc5 service nova] Creating event network-vif-plugged:1f650f36-60e3-4ddb-bb93-facba325d15f for instance bb5de453-e849-4495-8e25-6d3b0e8c3569 on user Apr 19 08:03:40 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-c501fd37-c58d-4ed7-a2f8-881d56c83a1b req-9cfc362a-d11c-4fcb-aaf1-c1cc7165cdc5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038983 Apr 19 08:03:40 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 69/205] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:03:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:03:42 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell0:SELECT=8 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:03:42 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-e44b182a-7465-4369-a2cf-5728e83fd7e2 req-c7fd401e-8449-409a-9e4e-3f975ca90d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb5de453-e849-4495-8e25-6d3b0e8c3569", "name": "network-vif-plugged", "status": "completed", "tag": "1f650f36-60e3-4ddb-bb93-facba325d15f"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:03:42 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-e44b182a-7465-4369-a2cf-5728e83fd7e2 req-c7fd401e-8449-409a-9e4e-3f975ca90d73 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:42 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-e44b182a-7465-4369-a2cf-5728e83fd7e2 req-c7fd401e-8449-409a-9e4e-3f975ca90d73 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:42 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-e44b182a-7465-4369-a2cf-5728e83fd7e2 req-c7fd401e-8449-409a-9e4e-3f975ca90d73 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:42 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-e44b182a-7465-4369-a2cf-5728e83fd7e2 req-c7fd401e-8449-409a-9e4e-3f975ca90d73 service nova] Creating event network-vif-plugged:1f650f36-60e3-4ddb-bb93-facba325d15f for instance bb5de453-e849-4495-8e25-6d3b0e8c3569 on user Apr 19 08:03:42 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-e44b182a-7465-4369-a2cf-5728e83fd7e2 req-c7fd401e-8449-409a-9e4e-3f975ca90d73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036140 Apr 19 08:03:42 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 70/206] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:03:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:03:42 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-de88dd72-8617-4bcc-b486-3318aff37511 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:42 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-de88dd72-8617-4bcc-b486-3318aff37511 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] [instance: 396bea78-4da8-4d59-b595-4617e997a3a0] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:03:42 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-de88dd72-8617-4bcc-b486-3318aff37511 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:42 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-de88dd72-8617-4bcc-b486-3318aff37511 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:42 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-de88dd72-8617-4bcc-b486-3318aff37511 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:42 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-de88dd72-8617-4bcc-b486-3318aff37511 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:42 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-de88dd72-8617-4bcc-b486-3318aff37511 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:42 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-de88dd72-8617-4bcc-b486-3318aff37511 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:43 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-de88dd72-8617-4bcc-b486-3318aff37511 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519a9c3c2f6e4c01a0115f12885554ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22007f1c0da74c8aa2bfea0a0d1e1b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:03:43 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-de88dd72-8617-4bcc-b486-3318aff37511 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] 10.0.0.210 "GET /compute/v2.1/servers/396bea78-4da8-4d59-b595-4617e997a3a0" status: 200 len: 1670 microversion: 2.1 time: 0.264994 Apr 19 08:03:43 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 68/207] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:03:42 2023] GET /compute/v2.1/servers/396bea78-4da8-4d59-b595-4617e997a3a0 => generated 1670 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:03:44 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-fcb8c51f-c8d3-4282-aa05-3a12808b1549 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Calling method '.version_select at 0x7f2c00f4f400>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:45 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-fcb8c51f-c8d3-4282-aa05-3a12808b1549 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/6f688f5a-65ae-455b-a4d6-9b148927c6ae" status: 204 len: 0 microversion: 2.1 time: 0.238901 Apr 19 08:03:45 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 70/208] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:03:44 2023] DELETE /compute/v2.1/images/6f688f5a-65ae-455b-a4d6-9b148927c6ae => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 08:03:45 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-e162288f-1666-4540-80b9-4731aa1540e5 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:45 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-e162288f-1666-4540-80b9-4731aa1540e5 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] [instance: 396bea78-4da8-4d59-b595-4617e997a3a0] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:03:45 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e162288f-1666-4540-80b9-4731aa1540e5 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:45 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e162288f-1666-4540-80b9-4731aa1540e5 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:45 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e162288f-1666-4540-80b9-4731aa1540e5 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:45 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e162288f-1666-4540-80b9-4731aa1540e5 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:45 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e162288f-1666-4540-80b9-4731aa1540e5 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:45 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e162288f-1666-4540-80b9-4731aa1540e5 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:45 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-e162288f-1666-4540-80b9-4731aa1540e5 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] [instance: 396bea78-4da8-4d59-b595-4617e997a3a0] Going to try to terminate instance {{(pid=61210) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:03:45 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-e162288f-1666-4540-80b9-4731aa1540e5 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/396bea78-4da8-4d59-b595-4617e997a3a0" status: 204 len: 0 microversion: 2.1 time: 0.120384 Apr 19 08:03:45 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 71/209] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:03:45 2023] DELETE /compute/v2.1/servers/396bea78-4da8-4d59-b595-4617e997a3a0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 08:03:45 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-d7e8a577-6d06-47a2-a0e8-50062f63c99e tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:03:45 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-d7e8a577-6d06-47a2-a0e8-50062f63c99e tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] [instance: 396bea78-4da8-4d59-b595-4617e997a3a0] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:03:45 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=6 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:03:45 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=18 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:03:45 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d7e8a577-6d06-47a2-a0e8-50062f63c99e tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:45 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d7e8a577-6d06-47a2-a0e8-50062f63c99e tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:45 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d7e8a577-6d06-47a2-a0e8-50062f63c99e tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:45 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d7e8a577-6d06-47a2-a0e8-50062f63c99e tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:45 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d7e8a577-6d06-47a2-a0e8-50062f63c99e tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:45 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d7e8a577-6d06-47a2-a0e8-50062f63c99e tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:45 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-d7e8a577-6d06-47a2-a0e8-50062f63c99e tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519a9c3c2f6e4c01a0115f12885554ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22007f1c0da74c8aa2bfea0a0d1e1b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:03:45 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-d7e8a577-6d06-47a2-a0e8-50062f63c99e tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] 10.0.0.210 "GET /compute/v2.1/servers/396bea78-4da8-4d59-b595-4617e997a3a0" status: 200 len: 1676 microversion: 2.1 time: 0.274636 Apr 19 08:03:45 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 69/210] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:03:45 2023] GET /compute/v2.1/servers/396bea78-4da8-4d59-b595-4617e997a3a0 => generated 1676 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:03:45 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=6 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:03:45 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-448dd099-304a-404b-bf08-83dba16fbc1c req-b3f36fb6-a7e3-402d-9fe3-ac7ca7a29b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "396bea78-4da8-4d59-b595-4617e997a3a0", "name": "network-vif-unplugged", "status": "completed", "tag": "12688fad-698e-449f-870c-d3e7e2e603da"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:03:45 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-448dd099-304a-404b-bf08-83dba16fbc1c req-b3f36fb6-a7e3-402d-9fe3-ac7ca7a29b6d service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:45 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-448dd099-304a-404b-bf08-83dba16fbc1c req-b3f36fb6-a7e3-402d-9fe3-ac7ca7a29b6d service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:45 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-448dd099-304a-404b-bf08-83dba16fbc1c req-b3f36fb6-a7e3-402d-9fe3-ac7ca7a29b6d service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:45 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-448dd099-304a-404b-bf08-83dba16fbc1c req-b3f36fb6-a7e3-402d-9fe3-ac7ca7a29b6d service nova] Creating event network-vif-unplugged:12688fad-698e-449f-870c-d3e7e2e603da for instance 396bea78-4da8-4d59-b595-4617e997a3a0 on user Apr 19 08:03:45 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-448dd099-304a-404b-bf08-83dba16fbc1c req-b3f36fb6-a7e3-402d-9fe3-ac7ca7a29b6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091456 Apr 19 08:03:45 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 71/211] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:03:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:03:47 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-c97b0fad-a40b-4f2c-8aa5-359390d810db req-0a2bc3dd-a319-4d35-ae3c-1c59c37c2d45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "396bea78-4da8-4d59-b595-4617e997a3a0", "name": "network-vif-plugged", "status": "completed", "tag": "12688fad-698e-449f-870c-d3e7e2e603da"}, {"server_uuid": "396bea78-4da8-4d59-b595-4617e997a3a0", "name": "network-vif-plugged", "status": "completed", "tag": "12688fad-698e-449f-870c-d3e7e2e603da"}, {"server_uuid": "396bea78-4da8-4d59-b595-4617e997a3a0", "name": "network-vif-plugged", "status": "completed", "tag": "12688fad-698e-449f-870c-d3e7e2e603da"}, {"server_uuid": "396bea78-4da8-4d59-b595-4617e997a3a0", "name": "network-vif-unplugged", "status": "completed", "tag": "12688fad-698e-449f-870c-d3e7e2e603da"}, {"server_uuid": "396bea78-4da8-4d59-b595-4617e997a3a0", "name": "network-vif-plugged", "status": "completed", "tag": "12688fad-698e-449f-870c-d3e7e2e603da"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:03:47 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-c97b0fad-a40b-4f2c-8aa5-359390d810db req-0a2bc3dd-a319-4d35-ae3c-1c59c37c2d45 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:47 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-c97b0fad-a40b-4f2c-8aa5-359390d810db req-0a2bc3dd-a319-4d35-ae3c-1c59c37c2d45 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:47 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-c97b0fad-a40b-4f2c-8aa5-359390d810db req-0a2bc3dd-a319-4d35-ae3c-1c59c37c2d45 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:47 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-3a348cdb-1c95-409b-90c7-45760297810a req-a87e3fb0-0341-4839-a7c3-63fb16ac0530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "396bea78-4da8-4d59-b595-4617e997a3a0", "name": "network-vif-deleted", "tag": "12688fad-698e-449f-870c-d3e7e2e603da"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:03:47 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-c97b0fad-a40b-4f2c-8aa5-359390d810db req-0a2bc3dd-a319-4d35-ae3c-1c59c37c2d45 service nova] Creating event network-vif-plugged:12688fad-698e-449f-870c-d3e7e2e603da for instance 396bea78-4da8-4d59-b595-4617e997a3a0 on user Apr 19 08:03:47 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-c97b0fad-a40b-4f2c-8aa5-359390d810db req-0a2bc3dd-a319-4d35-ae3c-1c59c37c2d45 service nova] Creating event network-vif-plugged:12688fad-698e-449f-870c-d3e7e2e603da for instance 396bea78-4da8-4d59-b595-4617e997a3a0 on user Apr 19 08:03:47 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-c97b0fad-a40b-4f2c-8aa5-359390d810db req-0a2bc3dd-a319-4d35-ae3c-1c59c37c2d45 service nova] Creating event network-vif-plugged:12688fad-698e-449f-870c-d3e7e2e603da for instance 396bea78-4da8-4d59-b595-4617e997a3a0 on user Apr 19 08:03:47 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-c97b0fad-a40b-4f2c-8aa5-359390d810db req-0a2bc3dd-a319-4d35-ae3c-1c59c37c2d45 service nova] Creating event network-vif-unplugged:12688fad-698e-449f-870c-d3e7e2e603da for instance 396bea78-4da8-4d59-b595-4617e997a3a0 on user Apr 19 08:03:47 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-c97b0fad-a40b-4f2c-8aa5-359390d810db req-0a2bc3dd-a319-4d35-ae3c-1c59c37c2d45 service nova] Creating event network-vif-plugged:12688fad-698e-449f-870c-d3e7e2e603da for instance 396bea78-4da8-4d59-b595-4617e997a3a0 on user Apr 19 08:03:47 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-c97b0fad-a40b-4f2c-8aa5-359390d810db req-0a2bc3dd-a319-4d35-ae3c-1c59c37c2d45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.033151 Apr 19 08:03:47 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-3a348cdb-1c95-409b-90c7-45760297810a req-a87e3fb0-0341-4839-a7c3-63fb16ac0530 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:03:47 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-3a348cdb-1c95-409b-90c7-45760297810a req-a87e3fb0-0341-4839-a7c3-63fb16ac0530 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:03:47 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 72/212] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:03:47 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:03:47 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-3a348cdb-1c95-409b-90c7-45760297810a req-a87e3fb0-0341-4839-a7c3-63fb16ac0530 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:03:47 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-3a348cdb-1c95-409b-90c7-45760297810a req-a87e3fb0-0341-4839-a7c3-63fb16ac0530 service nova] Creating event network-vif-deleted:12688fad-698e-449f-870c-d3e7e2e603da for instance 396bea78-4da8-4d59-b595-4617e997a3a0 on user Apr 19 08:03:47 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-3a348cdb-1c95-409b-90c7-45760297810a req-a87e3fb0-0341-4839-a7c3-63fb16ac0530 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030188 Apr 19 08:03:47 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 70/213] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:03:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:04:06 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:04:06 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=20 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:04:06 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-4ec7c5c5-448b-4e99-8979-07ff84331aed tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:04:06 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-4ec7c5c5-448b-4e99-8979-07ff84331aed tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] [instance: 75492904-1918-41fb-baf0-0ce2c1e65194] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:04:06 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4ec7c5c5-448b-4e99-8979-07ff84331aed tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:06 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4ec7c5c5-448b-4e99-8979-07ff84331aed tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:06 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4ec7c5c5-448b-4e99-8979-07ff84331aed tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:06 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4ec7c5c5-448b-4e99-8979-07ff84331aed tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:06 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4ec7c5c5-448b-4e99-8979-07ff84331aed tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:06 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4ec7c5c5-448b-4e99-8979-07ff84331aed tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:06 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-4ec7c5c5-448b-4e99-8979-07ff84331aed tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] [instance: 75492904-1918-41fb-baf0-0ce2c1e65194] Going to try to terminate instance {{(pid=61208) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:04:06 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-4ec7c5c5-448b-4e99-8979-07ff84331aed tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/75492904-1918-41fb-baf0-0ce2c1e65194" status: 204 len: 0 microversion: 2.1 time: 0.211331 Apr 19 08:04:06 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 72/214] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:04:06 2023] DELETE /compute/v2.1/servers/75492904-1918-41fb-baf0-0ce2c1e65194 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 08:04:06 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:04:06 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:04:06 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-af0f77a3-df00-4d3c-970b-392c5700a4ba tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:04:06 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-af0f77a3-df00-4d3c-970b-392c5700a4ba tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] [instance: 75492904-1918-41fb-baf0-0ce2c1e65194] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:04:06 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-af0f77a3-df00-4d3c-970b-392c5700a4ba tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:06 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-af0f77a3-df00-4d3c-970b-392c5700a4ba tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:06 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-af0f77a3-df00-4d3c-970b-392c5700a4ba tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:06 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-af0f77a3-df00-4d3c-970b-392c5700a4ba tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:06 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-af0f77a3-df00-4d3c-970b-392c5700a4ba tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:06 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-af0f77a3-df00-4d3c-970b-392c5700a4ba tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:06 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-80defffd-fec7-49e3-919a-c03d35823f31 req-65836124-de54-4efe-b732-acfd29c94463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75492904-1918-41fb-baf0-0ce2c1e65194", "name": "network-vif-unplugged", "status": "completed", "tag": "2d6b93cd-ee00-45c5-86f0-8d54e73a9e78"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:04:06 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=9 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:04:06 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=32 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:04:06 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-80defffd-fec7-49e3-919a-c03d35823f31 req-65836124-de54-4efe-b732-acfd29c94463 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:06 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-80defffd-fec7-49e3-919a-c03d35823f31 req-65836124-de54-4efe-b732-acfd29c94463 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:06 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-80defffd-fec7-49e3-919a-c03d35823f31 req-65836124-de54-4efe-b732-acfd29c94463 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:06 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-80defffd-fec7-49e3-919a-c03d35823f31 req-65836124-de54-4efe-b732-acfd29c94463 service nova] Creating event network-vif-unplugged:2d6b93cd-ee00-45c5-86f0-8d54e73a9e78 for instance 75492904-1918-41fb-baf0-0ce2c1e65194 on user Apr 19 08:04:06 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-af0f77a3-df00-4d3c-970b-392c5700a4ba tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef0fdb3c84ba9948b0806fd74f279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463fd5763cb24abeae209399cb8ff073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:04:06 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-80defffd-fec7-49e3-919a-c03d35823f31 req-65836124-de54-4efe-b732-acfd29c94463 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037023 Apr 19 08:04:06 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 71/215] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:04:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:04:06 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-af0f77a3-df00-4d3c-970b-392c5700a4ba tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75492904-1918-41fb-baf0-0ce2c1e65194" status: 200 len: 1501 microversion: 2.1 time: 0.252429 Apr 19 08:04:06 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 73/216] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:04:06 2023] GET /compute/v2.1/servers/75492904-1918-41fb-baf0-0ce2c1e65194 => generated 1501 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:04:07 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-e6efa3ac-65c5-4624-aa96-d66d329c3294 req-ae96279b-d75c-4b1f-81e1-8de94fe7d63d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75492904-1918-41fb-baf0-0ce2c1e65194", "name": "network-vif-deleted", "tag": "2d6b93cd-ee00-45c5-86f0-8d54e73a9e78"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:04:07 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-e6efa3ac-65c5-4624-aa96-d66d329c3294 req-ae96279b-d75c-4b1f-81e1-8de94fe7d63d service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:07 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-e6efa3ac-65c5-4624-aa96-d66d329c3294 req-ae96279b-d75c-4b1f-81e1-8de94fe7d63d service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:07 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-e6efa3ac-65c5-4624-aa96-d66d329c3294 req-ae96279b-d75c-4b1f-81e1-8de94fe7d63d service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:07 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-e6efa3ac-65c5-4624-aa96-d66d329c3294 req-ae96279b-d75c-4b1f-81e1-8de94fe7d63d service nova] Creating event network-vif-deleted:2d6b93cd-ee00-45c5-86f0-8d54e73a9e78 for instance 75492904-1918-41fb-baf0-0ce2c1e65194 on user Apr 19 08:04:07 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-e6efa3ac-65c5-4624-aa96-d66d329c3294 req-ae96279b-d75c-4b1f-81e1-8de94fe7d63d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037726 Apr 19 08:04:07 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 73/217] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:04:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:04:08 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-10a98865-d21d-4983-9412-397521194466 req-cc629358-6d50-4317-8aef-2306d500b32d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75492904-1918-41fb-baf0-0ce2c1e65194", "name": "network-vif-plugged", "status": "completed", "tag": "2d6b93cd-ee00-45c5-86f0-8d54e73a9e78"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:04:08 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-10a98865-d21d-4983-9412-397521194466 req-cc629358-6d50-4317-8aef-2306d500b32d service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:08 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-10a98865-d21d-4983-9412-397521194466 req-cc629358-6d50-4317-8aef-2306d500b32d service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:08 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-10a98865-d21d-4983-9412-397521194466 req-cc629358-6d50-4317-8aef-2306d500b32d service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:09 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-10a98865-d21d-4983-9412-397521194466 req-cc629358-6d50-4317-8aef-2306d500b32d service nova] Creating event network-vif-plugged:2d6b93cd-ee00-45c5-86f0-8d54e73a9e78 for instance 75492904-1918-41fb-baf0-0ce2c1e65194 on user Apr 19 08:04:09 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-10a98865-d21d-4983-9412-397521194466 req-cc629358-6d50-4317-8aef-2306d500b32d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028227 Apr 19 08:04:09 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 72/218] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:04:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:04:13 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-c23e04cd-2e22-4aea-9135-447e3d4bf73e tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:04:13 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-c23e04cd-2e22-4aea-9135-447e3d4bf73e tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] [instance: 02f0e5d6-1c4e-4549-8991-9dfcea958ac2] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:04:13 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-c23e04cd-2e22-4aea-9135-447e3d4bf73e tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:13 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-c23e04cd-2e22-4aea-9135-447e3d4bf73e tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:13 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-c23e04cd-2e22-4aea-9135-447e3d4bf73e tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:13 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-c23e04cd-2e22-4aea-9135-447e3d4bf73e tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:13 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-c23e04cd-2e22-4aea-9135-447e3d4bf73e tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:13 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-c23e04cd-2e22-4aea-9135-447e3d4bf73e tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:13 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-c23e04cd-2e22-4aea-9135-447e3d4bf73e tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32cbfb3d854d56ad3961da3f406e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8362c8d404717b2fa6e510f1de07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:04:13 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-c23e04cd-2e22-4aea-9135-447e3d4bf73e tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02f0e5d6-1c4e-4549-8991-9dfcea958ac2" status: 200 len: 1537 microversion: 2.1 time: 0.214127 Apr 19 08:04:13 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 74/219] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:04:13 2023] GET /compute/v2.1/servers/02f0e5d6-1c4e-4549-8991-9dfcea958ac2 => generated 1537 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:04:22 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:04:22 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:04:22 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-4c38dbee-9d2f-45f6-8633-96f397f24776 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:04:22 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-4c38dbee-9d2f-45f6-8633-96f397f24776 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] [instance: 2aa7cbc5-8b78-4631-a906-af3b4a63570a] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:04:22 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4c38dbee-9d2f-45f6-8633-96f397f24776 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:22 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4c38dbee-9d2f-45f6-8633-96f397f24776 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:22 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4c38dbee-9d2f-45f6-8633-96f397f24776 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:22 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4c38dbee-9d2f-45f6-8633-96f397f24776 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:22 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4c38dbee-9d2f-45f6-8633-96f397f24776 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:22 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4c38dbee-9d2f-45f6-8633-96f397f24776 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:22 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-4c38dbee-9d2f-45f6-8633-96f397f24776 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f18935b0524876bf69f22cff03139a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d73100ea55541d08952a24ef6931a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:04:22 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-4c38dbee-9d2f-45f6-8633-96f397f24776 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aa7cbc5-8b78-4631-a906-af3b4a63570a" status: 200 len: 1538 microversion: 2.1 time: 0.428304 Apr 19 08:04:22 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 74/220] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:04:22 2023] GET /compute/v2.1/servers/2aa7cbc5-8b78-4631-a906-af3b4a63570a => generated 1538 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:04:25 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=4 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:04:25 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=4 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:04:25 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-c1f10049-ccca-45c3-b16e-7d7d57579ef2 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:04:25 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-c1f10049-ccca-45c3-b16e-7d7d57579ef2 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] [instance: bb5de453-e849-4495-8e25-6d3b0e8c3569] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:04:25 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c1f10049-ccca-45c3-b16e-7d7d57579ef2 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:25 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c1f10049-ccca-45c3-b16e-7d7d57579ef2 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:25 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c1f10049-ccca-45c3-b16e-7d7d57579ef2 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:25 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c1f10049-ccca-45c3-b16e-7d7d57579ef2 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:25 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c1f10049-ccca-45c3-b16e-7d7d57579ef2 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:25 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-c1f10049-ccca-45c3-b16e-7d7d57579ef2 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:25 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-c1f10049-ccca-45c3-b16e-7d7d57579ef2 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8043565b02bb4f63b4a0b552b7191098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f06d44ee43138f373093d40014fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:04:25 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-c1f10049-ccca-45c3-b16e-7d7d57579ef2 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb5de453-e849-4495-8e25-6d3b0e8c3569" status: 200 len: 1568 microversion: 2.1 time: 0.448112 Apr 19 08:04:25 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 73/221] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:04:25 2023] GET /compute/v2.1/servers/bb5de453-e849-4495-8e25-6d3b0e8c3569 => generated 1568 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:04:29 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-b305ea6a-93bd-4623-933c-737673df2f6a tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:04:29 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-b305ea6a-93bd-4623-933c-737673df2f6a tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] [instance: bdeeb437-76a3-49b5-9553-d2da74917d69] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:04:29 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=4 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:04:29 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=12 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:04:29 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-b305ea6a-93bd-4623-933c-737673df2f6a tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:29 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-b305ea6a-93bd-4623-933c-737673df2f6a tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:29 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-b305ea6a-93bd-4623-933c-737673df2f6a tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:29 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-b305ea6a-93bd-4623-933c-737673df2f6a tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:29 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-b305ea6a-93bd-4623-933c-737673df2f6a tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:29 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-b305ea6a-93bd-4623-933c-737673df2f6a tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:30 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-b305ea6a-93bd-4623-933c-737673df2f6a tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dc2a88f2d149a1a4035ed1c7e74b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcde8c2a3444e919d232ea854c00e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:04:30 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-b305ea6a-93bd-4623-933c-737673df2f6a tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69" status: 200 len: 1658 microversion: 2.1 time: 0.294400 Apr 19 08:04:30 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 75/222] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:04:29 2023] GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69 => generated 1658 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:04:34 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-91b4a9c8-8d82-4e89-b921-27d1155bd4db tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:04:34 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-91b4a9c8-8d82-4e89-b921-27d1155bd4db tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] [instance: a36b83d3-7114-49dc-9632-48c0dacafbf8] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:04:34 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:04:34 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=6 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:04:34 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-91b4a9c8-8d82-4e89-b921-27d1155bd4db tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:34 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-91b4a9c8-8d82-4e89-b921-27d1155bd4db tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:34 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-91b4a9c8-8d82-4e89-b921-27d1155bd4db tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:34 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-91b4a9c8-8d82-4e89-b921-27d1155bd4db tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:34 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-91b4a9c8-8d82-4e89-b921-27d1155bd4db tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:34 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-91b4a9c8-8d82-4e89-b921-27d1155bd4db tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:34 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-91b4a9c8-8d82-4e89-b921-27d1155bd4db tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] [instance: a36b83d3-7114-49dc-9632-48c0dacafbf8] Going to try to terminate instance {{(pid=61208) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:04:35 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-91b4a9c8-8d82-4e89-b921-27d1155bd4db tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a36b83d3-7114-49dc-9632-48c0dacafbf8" status: 204 len: 0 microversion: 2.1 time: 0.117946 Apr 19 08:04:35 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 75/223] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:04:34 2023] DELETE /compute/v2.1/servers/a36b83d3-7114-49dc-9632-48c0dacafbf8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 08:04:35 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-9279c570-f82c-4d21-9a62-5f8ea227a3b0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:04:35 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-9279c570-f82c-4d21-9a62-5f8ea227a3b0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] [instance: a36b83d3-7114-49dc-9632-48c0dacafbf8] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:04:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-9279c570-f82c-4d21-9a62-5f8ea227a3b0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-9279c570-f82c-4d21-9a62-5f8ea227a3b0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-9279c570-f82c-4d21-9a62-5f8ea227a3b0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-9279c570-f82c-4d21-9a62-5f8ea227a3b0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-9279c570-f82c-4d21-9a62-5f8ea227a3b0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-9279c570-f82c-4d21-9a62-5f8ea227a3b0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:35 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-9279c570-f82c-4d21-9a62-5f8ea227a3b0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9796d2c200d4419b0fe67d541efc8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173f7e00d8f748debe5a126203220f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:04:35 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-9279c570-f82c-4d21-9a62-5f8ea227a3b0 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a36b83d3-7114-49dc-9632-48c0dacafbf8" status: 200 len: 1496 microversion: 2.1 time: 0.256328 Apr 19 08:04:35 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 74/224] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:04:35 2023] GET /compute/v2.1/servers/a36b83d3-7114-49dc-9632-48c0dacafbf8 => generated 1496 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:04:35 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-3e98bb0a-d38a-4b59-b9ba-eec751344253 req-1e8343f5-04cc-497e-b8ab-521cd1bfa209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36b83d3-7114-49dc-9632-48c0dacafbf8", "name": "network-vif-unplugged", "status": "completed", "tag": "f80986be-013a-49c0-bb54-96d55ce82748"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:04:35 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-3e98bb0a-d38a-4b59-b9ba-eec751344253 req-1e8343f5-04cc-497e-b8ab-521cd1bfa209 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:35 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-3e98bb0a-d38a-4b59-b9ba-eec751344253 req-1e8343f5-04cc-497e-b8ab-521cd1bfa209 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:35 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-3e98bb0a-d38a-4b59-b9ba-eec751344253 req-1e8343f5-04cc-497e-b8ab-521cd1bfa209 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:35 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-3e98bb0a-d38a-4b59-b9ba-eec751344253 req-1e8343f5-04cc-497e-b8ab-521cd1bfa209 service nova] Creating event network-vif-unplugged:f80986be-013a-49c0-bb54-96d55ce82748 for instance a36b83d3-7114-49dc-9632-48c0dacafbf8 on user Apr 19 08:04:35 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-3e98bb0a-d38a-4b59-b9ba-eec751344253 req-1e8343f5-04cc-497e-b8ab-521cd1bfa209 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034161 Apr 19 08:04:35 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 76/225] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:04:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:04:35 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-05a3a816-286c-44a7-87e5-15b97e4f3490 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:04:35 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-05a3a816-286c-44a7-87e5-15b97e4f3490 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] [instance: 396bea78-4da8-4d59-b595-4617e997a3a0] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:04:35 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-05a3a816-286c-44a7-87e5-15b97e4f3490 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:35 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-05a3a816-286c-44a7-87e5-15b97e4f3490 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:35 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-05a3a816-286c-44a7-87e5-15b97e4f3490 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:35 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-05a3a816-286c-44a7-87e5-15b97e4f3490 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:35 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-05a3a816-286c-44a7-87e5-15b97e4f3490 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:35 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-05a3a816-286c-44a7-87e5-15b97e4f3490 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:35 user devstack@n-api.service[61208]: INFO nova.api.openstack.wsgi [None req-05a3a816-286c-44a7-87e5-15b97e4f3490 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] HTTP exception thrown: Instance 396bea78-4da8-4d59-b595-4617e997a3a0 could not be found. Apr 19 08:04:35 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-05a3a816-286c-44a7-87e5-15b97e4f3490 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Request method failure captured: Apr 19 08:04:35 user devstack@n-api.service[61208]: request: GET /compute/v2.1/servers/396bea78-4da8-4d59-b595-4617e997a3a0 HTTP/1.1 Apr 19 08:04:35 user devstack@n-api.service[61208]: Accept: application/json Apr 19 08:04:35 user devstack@n-api.service[61208]: Accept-Encoding: identity Apr 19 08:04:35 user devstack@n-api.service[61208]: Connection: close Apr 19 08:04:35 user devstack@n-api.service[61208]: Content-Length: 0 Apr 19 08:04:35 user devstack@n-api.service[61208]: Content-Type: application/json Apr 19 08:04:35 user devstack@n-api.service[61208]: Host: 10.0.0.210 Apr 19 08:04:35 user devstack@n-api.service[61208]: Openstack-System-Scope: None Apr 19 08:04:35 user devstack@n-api.service[61208]: User-Agent: python-urllib3/1.26.15 Apr 19 08:04:35 user devstack@n-api.service[61208]: X-Auth-Token: gAAAAABkP590AJ2Vs8DLPI_ViD8AeZdorki0O7J9KhAArofXhDLtE497A4OISiyA6FyaiSKn0vpmfJYRVTZK-yZEfOryRaYQBdTm6z94EMyYoufAtwHpGqH03hgSkORyu6iVYfe5FbpGQYTHo-M0MeVpV4ziS_KhGu3QnvxTLjwRmNMagV2m4b4 Apr 19 08:04:35 user devstack@n-api.service[61208]: X-Domain-Id: None Apr 19 08:04:35 user devstack@n-api.service[61208]: X-Domain-Name: None Apr 19 08:04:35 user devstack@n-api.service[61208]: X-Identity-Status: Confirmed Apr 19 08:04:35 user devstack@n-api.service[61208]: X-Is-Admin-Project: True Apr 19 08:04:35 user devstack@n-api.service[61208]: X-Project-Domain-Id: default Apr 19 08:04:35 user devstack@n-api.service[61208]: X-Project-Domain-Name: Default Apr 19 08:04:35 user devstack@n-api.service[61208]: X-Project-Id: 22007f1c0da74c8aa2bfea0a0d1e1b98 Apr 19 08:04:35 user devstack@n-api.service[61208]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1679904729 Apr 19 08:04:35 user devstack@n-api.service[61208]: X-Role: reader,member Apr 19 08:04:35 user devstack@n-api.service[61208]: X-Roles: reader,member Apr 19 08:04:35 user devstack@n-api.service[61208]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/22007f1c0da74c8aa2bfea0a0d1e1b98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/22007f1c0da74c8aa2bfea0a0d1e1b98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/22007f1c0da74c8aa2bfea0a0d1e1b98"}]}] Apr 19 08:04:35 user devstack@n-api.service[61208]: X-Tenant: tempest-ServerStableDeviceRescueTest-1679904729 Apr 19 08:04:35 user devstack@n-api.service[61208]: X-Tenant-Id: 22007f1c0da74c8aa2bfea0a0d1e1b98 Apr 19 08:04:35 user devstack@n-api.service[61208]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1679904729 Apr 19 08:04:35 user devstack@n-api.service[61208]: X-User: tempest-ServerStableDeviceRescueTest-1679904729-project-member Apr 19 08:04:35 user devstack@n-api.service[61208]: X-User-Domain-Id: default Apr 19 08:04:35 user devstack@n-api.service[61208]: X-User-Domain-Name: Default Apr 19 08:04:35 user devstack@n-api.service[61208]: X-User-Id: 519a9c3c2f6e4c01a0115f12885554ec Apr 19 08:04:35 user devstack@n-api.service[61208]: X-User-Name: tempest-ServerStableDeviceRescueTest-1679904729-project-member Apr 19 08:04:35 user devstack@n-api.service[61208]: method: > Apr 19 08:04:35 user devstack@n-api.service[61208]: exception: Instance 396bea78-4da8-4d59-b595-4617e997a3a0 could not be found. Apr 19 08:04:35 user devstack@n-api.service[61208]: action_args: {'id': '396bea78-4da8-4d59-b595-4617e997a3a0'} Apr 19 08:04:35 user devstack@n-api.service[61208]: {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 396bea78-4da8-4d59-b595-4617e997a3a0 could not be found. Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 396bea78-4da8-4d59-b595-4617e997a3a0 could not be found. Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 396bea78-4da8-4d59-b595-4617e997a3a0 could not be found. Apr 19 08:04:35 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:04:35 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-05a3a816-286c-44a7-87e5-15b97e4f3490 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Returning 404 to user: Instance 396bea78-4da8-4d59-b595-4617e997a3a0 could not be found. {{(pid=61208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:04:35 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-05a3a816-286c-44a7-87e5-15b97e4f3490 tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] 10.0.0.210 "GET /compute/v2.1/servers/396bea78-4da8-4d59-b595-4617e997a3a0" status: 404 len: 111 microversion: 2.1 time: 0.035288 Apr 19 08:04:35 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 76/226] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:04:35 2023] GET /compute/v2.1/servers/396bea78-4da8-4d59-b595-4617e997a3a0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:04:35 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-2405979c-6e8a-4025-8b84-671fd626e35c tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] Calling method '.version_select at 0x7f2c010cc160>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:04:35 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-2405979c-6e8a-4025-8b84-671fd626e35c tempest-ServerStableDeviceRescueTest-1679904729 tempest-ServerStableDeviceRescueTest-1679904729-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2048212060" status: 202 len: 0 microversion: 2.1 time: 0.029342 Apr 19 08:04:35 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 75/227] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 08:04:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2048212060 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 08:04:37 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-06a6372d-5ea9-428e-ae08-db208ce961fd req-503c78d1-955e-4408-9bbc-ed7b79a81713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36b83d3-7114-49dc-9632-48c0dacafbf8", "name": "network-vif-plugged", "status": "completed", "tag": "f80986be-013a-49c0-bb54-96d55ce82748"}, {"server_uuid": "a36b83d3-7114-49dc-9632-48c0dacafbf8", "name": "network-vif-deleted", "tag": "f80986be-013a-49c0-bb54-96d55ce82748"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:04:37 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-06a6372d-5ea9-428e-ae08-db208ce961fd req-503c78d1-955e-4408-9bbc-ed7b79a81713 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:37 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-06a6372d-5ea9-428e-ae08-db208ce961fd req-503c78d1-955e-4408-9bbc-ed7b79a81713 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:37 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-06a6372d-5ea9-428e-ae08-db208ce961fd req-503c78d1-955e-4408-9bbc-ed7b79a81713 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:37 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-06a6372d-5ea9-428e-ae08-db208ce961fd req-503c78d1-955e-4408-9bbc-ed7b79a81713 service nova] Creating event network-vif-plugged:f80986be-013a-49c0-bb54-96d55ce82748 for instance a36b83d3-7114-49dc-9632-48c0dacafbf8 on user Apr 19 08:04:37 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-06a6372d-5ea9-428e-ae08-db208ce961fd req-503c78d1-955e-4408-9bbc-ed7b79a81713 service nova] Creating event network-vif-deleted:f80986be-013a-49c0-bb54-96d55ce82748 for instance a36b83d3-7114-49dc-9632-48c0dacafbf8 on user Apr 19 08:04:37 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-06a6372d-5ea9-428e-ae08-db208ce961fd req-503c78d1-955e-4408-9bbc-ed7b79a81713 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028752 Apr 19 08:04:37 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 77/228] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:04:37 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:04:48 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:04:48 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:04:48 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-27e2151d-a0be-4c62-8340-a66ebb498567 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-601761688", "imageRef": "b515545f-3b22-4d80-a102-6a318ab9717a", "flavorRef": "42", "networks": [{"uuid": "d4c2bd9d-7482-4ff6-9de8-da32da3110f7"}]}} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:04:48 user devstack@n-api.service[61208]: DEBUG nova.network.neutron [None req-27e2151d-a0be-4c62-8340-a66ebb498567 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] validate_networks() for [('d4c2bd9d-7482-4ff6-9de8-da32da3110f7', None, None, None, None, None)] {{(pid=61208) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 08:04:48 user devstack@n-api.service[61208]: DEBUG nova.virt.hardware [None req-27e2151d-a0be-4c62-8340-a66ebb498567 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Flavor limits 0:0:0 {{(pid=61208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 08:04:48 user devstack@n-api.service[61208]: DEBUG nova.virt.hardware [None req-27e2151d-a0be-4c62-8340-a66ebb498567 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Image limits 0:0:0 {{(pid=61208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 08:04:48 user devstack@n-api.service[61208]: DEBUG nova.virt.hardware [None req-27e2151d-a0be-4c62-8340-a66ebb498567 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Flavor pref 0:0:0 {{(pid=61208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 08:04:48 user devstack@n-api.service[61208]: DEBUG nova.virt.hardware [None req-27e2151d-a0be-4c62-8340-a66ebb498567 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Image pref 0:0:0 {{(pid=61208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 08:04:48 user devstack@n-api.service[61208]: DEBUG nova.virt.hardware [None req-27e2151d-a0be-4c62-8340-a66ebb498567 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 08:04:48 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-27e2151d-a0be-4c62-8340-a66ebb498567 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:48 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-27e2151d-a0be-4c62-8340-a66ebb498567 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:48 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-27e2151d-a0be-4c62-8340-a66ebb498567 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:48 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-27e2151d-a0be-4c62-8340-a66ebb498567 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:48 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-27e2151d-a0be-4c62-8340-a66ebb498567 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:48 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-27e2151d-a0be-4c62-8340-a66ebb498567 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:48 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-27e2151d-a0be-4c62-8340-a66ebb498567 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Getting quotas for project 789f98320d1745918cc7e2ca0ddf0ca8. Resources: {'ram', 'cores', 'instances'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:04:48 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-27e2151d-a0be-4c62-8340-a66ebb498567 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Getting quotas for user 2027c586717a407baa7cd8f3cdc56459 and project 789f98320d1745918cc7e2ca0ddf0ca8. Resources: {'ram', 'cores', 'instances'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:04:48 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-27e2151d-a0be-4c62-8340-a66ebb498567 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Going to run 1 instances... {{(pid=61208) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 08:04:48 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-27e2151d-a0be-4c62-8340-a66ebb498567 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] [instance: 266d27ff-db1d-443a-8562-b67a859afe20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b515545f-3b22-4d80-a102-6a318ab9717a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61208) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 08:04:49 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-27e2151d-a0be-4c62-8340-a66ebb498567 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.827637 Apr 19 08:04:49 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 77/229] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 08:04:48 2023] POST /compute/v2.1/servers => generated 378 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 08:04:49 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=12 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:04:49 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:04:49 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-d3f9f328-aeed-409e-9ea6-e487bc2b32b3 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:04:49 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-d3f9f328-aeed-409e-9ea6-e487bc2b32b3 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] [instance: 266d27ff-db1d-443a-8562-b67a859afe20] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:04:49 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-d3f9f328-aeed-409e-9ea6-e487bc2b32b3 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2027c586717a407baa7cd8f3cdc56459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f98320d1745918cc7e2ca0ddf0ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:04:49 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-d3f9f328-aeed-409e-9ea6-e487bc2b32b3 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/266d27ff-db1d-443a-8562-b67a859afe20" status: 200 len: 1210 microversion: 2.1 time: 0.070330 Apr 19 08:04:49 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 76/230] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:04:49 2023] GET /compute/v2.1/servers/266d27ff-db1d-443a-8562-b67a859afe20 => generated 1210 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:04:52 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=6 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:04:52 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=10 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:04:52 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-fb788622-878c-4b58-b6ce-2e2664e5e3ed req-22448cac-d64d-4dfd-b0e8-8d6a58213ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "266d27ff-db1d-443a-8562-b67a859afe20", "tag": "53ae4f57-536a-4554-9f8c-1c465454184c"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:04:52 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-fb788622-878c-4b58-b6ce-2e2664e5e3ed req-22448cac-d64d-4dfd-b0e8-8d6a58213ec1 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:52 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-fb788622-878c-4b58-b6ce-2e2664e5e3ed req-22448cac-d64d-4dfd-b0e8-8d6a58213ec1 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:52 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-fb788622-878c-4b58-b6ce-2e2664e5e3ed req-22448cac-d64d-4dfd-b0e8-8d6a58213ec1 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:52 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-fb788622-878c-4b58-b6ce-2e2664e5e3ed req-22448cac-d64d-4dfd-b0e8-8d6a58213ec1 service nova] Creating event network-changed:53ae4f57-536a-4554-9f8c-1c465454184c for instance 266d27ff-db1d-443a-8562-b67a859afe20 on user Apr 19 08:04:52 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-fb788622-878c-4b58-b6ce-2e2664e5e3ed req-22448cac-d64d-4dfd-b0e8-8d6a58213ec1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089501 Apr 19 08:04:52 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 78/231] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:04:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:04:54 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-f0f02915-80f1-42d9-9c90-c96471a7cae6 req-db9e67eb-504b-4e87-90a5-c571e57dc45c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "266d27ff-db1d-443a-8562-b67a859afe20", "name": "network-vif-plugged", "status": "completed", "tag": "53ae4f57-536a-4554-9f8c-1c465454184c"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:04:54 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-f0f02915-80f1-42d9-9c90-c96471a7cae6 req-db9e67eb-504b-4e87-90a5-c571e57dc45c service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:54 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-f0f02915-80f1-42d9-9c90-c96471a7cae6 req-db9e67eb-504b-4e87-90a5-c571e57dc45c service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:54 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-f0f02915-80f1-42d9-9c90-c96471a7cae6 req-db9e67eb-504b-4e87-90a5-c571e57dc45c service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:54 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-f0f02915-80f1-42d9-9c90-c96471a7cae6 req-db9e67eb-504b-4e87-90a5-c571e57dc45c service nova] Creating event network-vif-plugged:53ae4f57-536a-4554-9f8c-1c465454184c for instance 266d27ff-db1d-443a-8562-b67a859afe20 on user Apr 19 08:04:54 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-f0f02915-80f1-42d9-9c90-c96471a7cae6 req-db9e67eb-504b-4e87-90a5-c571e57dc45c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054339 Apr 19 08:04:54 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 78/232] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:04:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:04:56 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-5e062f2a-cf66-4043-b543-0d69c80137e7 req-b1da8ca6-6cf9-4d9d-9ae2-4ff890d6263b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "266d27ff-db1d-443a-8562-b67a859afe20", "name": "network-vif-plugged", "status": "completed", "tag": "53ae4f57-536a-4554-9f8c-1c465454184c"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:04:56 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-5e062f2a-cf66-4043-b543-0d69c80137e7 req-b1da8ca6-6cf9-4d9d-9ae2-4ff890d6263b service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:56 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-5e062f2a-cf66-4043-b543-0d69c80137e7 req-b1da8ca6-6cf9-4d9d-9ae2-4ff890d6263b service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:56 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-5e062f2a-cf66-4043-b543-0d69c80137e7 req-b1da8ca6-6cf9-4d9d-9ae2-4ff890d6263b service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:56 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-5e062f2a-cf66-4043-b543-0d69c80137e7 req-b1da8ca6-6cf9-4d9d-9ae2-4ff890d6263b service nova] Creating event network-vif-plugged:53ae4f57-536a-4554-9f8c-1c465454184c for instance 266d27ff-db1d-443a-8562-b67a859afe20 on user Apr 19 08:04:56 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-5e062f2a-cf66-4043-b543-0d69c80137e7 req-b1da8ca6-6cf9-4d9d-9ae2-4ff890d6263b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035053 Apr 19 08:04:56 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 77/233] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:04:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:04:57 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-a180bdc8-ae5d-4288-b6a1-7e72dfee7ac4 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:04:57 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-a180bdc8-ae5d-4288-b6a1-7e72dfee7ac4 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] [instance: 75492904-1918-41fb-baf0-0ce2c1e65194] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:04:57 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a180bdc8-ae5d-4288-b6a1-7e72dfee7ac4 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:57 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a180bdc8-ae5d-4288-b6a1-7e72dfee7ac4 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:57 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a180bdc8-ae5d-4288-b6a1-7e72dfee7ac4 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:57 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a180bdc8-ae5d-4288-b6a1-7e72dfee7ac4 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:57 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a180bdc8-ae5d-4288-b6a1-7e72dfee7ac4 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:57 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a180bdc8-ae5d-4288-b6a1-7e72dfee7ac4 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:57 user devstack@n-api.service[61210]: INFO nova.api.openstack.wsgi [None req-a180bdc8-ae5d-4288-b6a1-7e72dfee7ac4 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] HTTP exception thrown: Instance 75492904-1918-41fb-baf0-0ce2c1e65194 could not be found. Apr 19 08:04:57 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-a180bdc8-ae5d-4288-b6a1-7e72dfee7ac4 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Request method failure captured: Apr 19 08:04:57 user devstack@n-api.service[61210]: request: GET /compute/v2.1/servers/75492904-1918-41fb-baf0-0ce2c1e65194 HTTP/1.1 Apr 19 08:04:57 user devstack@n-api.service[61210]: Accept: application/json Apr 19 08:04:57 user devstack@n-api.service[61210]: Accept-Encoding: identity Apr 19 08:04:57 user devstack@n-api.service[61210]: Connection: close Apr 19 08:04:57 user devstack@n-api.service[61210]: Content-Length: 0 Apr 19 08:04:57 user devstack@n-api.service[61210]: Content-Type: application/json Apr 19 08:04:57 user devstack@n-api.service[61210]: Host: 10.0.0.210 Apr 19 08:04:57 user devstack@n-api.service[61210]: Openstack-System-Scope: None Apr 19 08:04:57 user devstack@n-api.service[61210]: User-Agent: python-urllib3/1.26.15 Apr 19 08:04:57 user devstack@n-api.service[61210]: X-Auth-Token: gAAAAABkP590q-ahQ5Y29nCjt-XVZex3NkwRRBb-e-hqThgBRftwXijZprl56weIlu4IFAZqImZw1OzRgUNn6GuqXr92gnS-u5cclHGrfBdQqLs4z0QFZX7pS8zztUPRvKyfHzPEsg7zarTo4ipl89UvYoGiXCiVu_NE26JgAlcta1LO8UrPKuY Apr 19 08:04:57 user devstack@n-api.service[61210]: X-Domain-Id: None Apr 19 08:04:57 user devstack@n-api.service[61210]: X-Domain-Name: None Apr 19 08:04:57 user devstack@n-api.service[61210]: X-Identity-Status: Confirmed Apr 19 08:04:57 user devstack@n-api.service[61210]: X-Is-Admin-Project: True Apr 19 08:04:57 user devstack@n-api.service[61210]: X-Project-Domain-Id: default Apr 19 08:04:57 user devstack@n-api.service[61210]: X-Project-Domain-Name: Default Apr 19 08:04:57 user devstack@n-api.service[61210]: X-Project-Id: 463fd5763cb24abeae209399cb8ff073 Apr 19 08:04:57 user devstack@n-api.service[61210]: X-Project-Name: tempest-VolumesAdminNegativeTest-1601310038 Apr 19 08:04:57 user devstack@n-api.service[61210]: X-Role: reader,member Apr 19 08:04:57 user devstack@n-api.service[61210]: X-Roles: reader,member Apr 19 08:04:57 user devstack@n-api.service[61210]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/463fd5763cb24abeae209399cb8ff073"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/463fd5763cb24abeae209399cb8ff073"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/463fd5763cb24abeae209399cb8ff073"}]}] Apr 19 08:04:57 user devstack@n-api.service[61210]: X-Tenant: tempest-VolumesAdminNegativeTest-1601310038 Apr 19 08:04:57 user devstack@n-api.service[61210]: X-Tenant-Id: 463fd5763cb24abeae209399cb8ff073 Apr 19 08:04:57 user devstack@n-api.service[61210]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1601310038 Apr 19 08:04:57 user devstack@n-api.service[61210]: X-User: tempest-VolumesAdminNegativeTest-1601310038-project-member Apr 19 08:04:57 user devstack@n-api.service[61210]: X-User-Domain-Id: default Apr 19 08:04:57 user devstack@n-api.service[61210]: X-User-Domain-Name: Default Apr 19 08:04:57 user devstack@n-api.service[61210]: X-User-Id: c38ef0fdb3c84ba9948b0806fd74f279 Apr 19 08:04:57 user devstack@n-api.service[61210]: X-User-Name: tempest-VolumesAdminNegativeTest-1601310038-project-member Apr 19 08:04:57 user devstack@n-api.service[61210]: method: > Apr 19 08:04:57 user devstack@n-api.service[61210]: exception: Instance 75492904-1918-41fb-baf0-0ce2c1e65194 could not be found. Apr 19 08:04:57 user devstack@n-api.service[61210]: action_args: {'id': '75492904-1918-41fb-baf0-0ce2c1e65194'} Apr 19 08:04:57 user devstack@n-api.service[61210]: {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75492904-1918-41fb-baf0-0ce2c1e65194 could not be found. Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75492904-1918-41fb-baf0-0ce2c1e65194 could not be found. Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75492904-1918-41fb-baf0-0ce2c1e65194 could not be found. Apr 19 08:04:57 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:04:57 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-a180bdc8-ae5d-4288-b6a1-7e72dfee7ac4 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Returning 404 to user: Instance 75492904-1918-41fb-baf0-0ce2c1e65194 could not be found. {{(pid=61210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:04:57 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-a180bdc8-ae5d-4288-b6a1-7e72dfee7ac4 tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75492904-1918-41fb-baf0-0ce2c1e65194" status: 404 len: 111 microversion: 2.1 time: 0.030043 Apr 19 08:04:57 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 79/234] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:04:57 2023] GET /compute/v2.1/servers/75492904-1918-41fb-baf0-0ce2c1e65194 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:04:57 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-be5adf9b-4176-4af9-b351-3e630493edff tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:04:57 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-be5adf9b-4176-4af9-b351-3e630493edff tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] [instance: 4fae3aae-cb67-4c14-b358-59248d99238d] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:04:57 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-be5adf9b-4176-4af9-b351-3e630493edff tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:57 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-be5adf9b-4176-4af9-b351-3e630493edff tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:57 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-be5adf9b-4176-4af9-b351-3e630493edff tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:57 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-be5adf9b-4176-4af9-b351-3e630493edff tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:57 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-be5adf9b-4176-4af9-b351-3e630493edff tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:57 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-be5adf9b-4176-4af9-b351-3e630493edff tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:57 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-be5adf9b-4176-4af9-b351-3e630493edff tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] [instance: 4fae3aae-cb67-4c14-b358-59248d99238d] Going to try to terminate instance {{(pid=61208) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:04:57 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-be5adf9b-4176-4af9-b351-3e630493edff tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4fae3aae-cb67-4c14-b358-59248d99238d" status: 204 len: 0 microversion: 2.1 time: 0.111168 Apr 19 08:04:57 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 79/235] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:04:57 2023] DELETE /compute/v2.1/servers/4fae3aae-cb67-4c14-b358-59248d99238d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 08:04:57 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-44451d41-533a-4568-a4fc-7f85a1d7994a tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:04:57 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-44451d41-533a-4568-a4fc-7f85a1d7994a tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] [instance: 4fae3aae-cb67-4c14-b358-59248d99238d] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:04:57 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-44451d41-533a-4568-a4fc-7f85a1d7994a tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:57 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-44451d41-533a-4568-a4fc-7f85a1d7994a tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:57 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-44451d41-533a-4568-a4fc-7f85a1d7994a tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:57 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-44451d41-533a-4568-a4fc-7f85a1d7994a tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:57 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-44451d41-533a-4568-a4fc-7f85a1d7994a tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:57 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-44451d41-533a-4568-a4fc-7f85a1d7994a tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:57 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-44451d41-533a-4568-a4fc-7f85a1d7994a tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38ef0fdb3c84ba9948b0806fd74f279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '463fd5763cb24abeae209399cb8ff073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:04:57 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-44451d41-533a-4568-a4fc-7f85a1d7994a tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fae3aae-cb67-4c14-b358-59248d99238d" status: 200 len: 1670 microversion: 2.1 time: 0.257807 Apr 19 08:04:57 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 78/236] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:04:57 2023] GET /compute/v2.1/servers/4fae3aae-cb67-4c14-b358-59248d99238d => generated 1670 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:04:58 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-21fa91bf-58d0-41fa-a8de-201189cdec30 req-d3e42d45-fe4a-4409-96f4-2eefeb4bf97f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fae3aae-cb67-4c14-b358-59248d99238d", "name": "network-vif-unplugged", "status": "completed", "tag": "0099c8b1-71b7-45a0-abe2-aeecf2e3e73b"}, {"server_uuid": "4fae3aae-cb67-4c14-b358-59248d99238d", "name": "network-vif-plugged", "status": "completed", "tag": "0099c8b1-71b7-45a0-abe2-aeecf2e3e73b"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:04:58 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-21fa91bf-58d0-41fa-a8de-201189cdec30 req-d3e42d45-fe4a-4409-96f4-2eefeb4bf97f service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:04:58 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-21fa91bf-58d0-41fa-a8de-201189cdec30 req-d3e42d45-fe4a-4409-96f4-2eefeb4bf97f service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:04:58 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-21fa91bf-58d0-41fa-a8de-201189cdec30 req-d3e42d45-fe4a-4409-96f4-2eefeb4bf97f service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:04:58 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-21fa91bf-58d0-41fa-a8de-201189cdec30 req-d3e42d45-fe4a-4409-96f4-2eefeb4bf97f service nova] Creating event network-vif-unplugged:0099c8b1-71b7-45a0-abe2-aeecf2e3e73b for instance 4fae3aae-cb67-4c14-b358-59248d99238d on user Apr 19 08:04:58 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-21fa91bf-58d0-41fa-a8de-201189cdec30 req-d3e42d45-fe4a-4409-96f4-2eefeb4bf97f service nova] Creating event network-vif-plugged:0099c8b1-71b7-45a0-abe2-aeecf2e3e73b for instance 4fae3aae-cb67-4c14-b358-59248d99238d on user Apr 19 08:04:58 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-21fa91bf-58d0-41fa-a8de-201189cdec30 req-d3e42d45-fe4a-4409-96f4-2eefeb4bf97f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.034789 Apr 19 08:04:58 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 80/237] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:04:58 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:05:00 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-a48d25e4-edfc-4472-a643-f5dea8e1ca66 req-51fc7ccc-6c7d-4c03-b5a7-aca0f0e6393a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fae3aae-cb67-4c14-b358-59248d99238d", "name": "network-vif-deleted", "tag": "0099c8b1-71b7-45a0-abe2-aeecf2e3e73b"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:05:00 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:05:00 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=6 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:05:00 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-a48d25e4-edfc-4472-a643-f5dea8e1ca66 req-51fc7ccc-6c7d-4c03-b5a7-aca0f0e6393a service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:00 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-a48d25e4-edfc-4472-a643-f5dea8e1ca66 req-51fc7ccc-6c7d-4c03-b5a7-aca0f0e6393a service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:00 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-a48d25e4-edfc-4472-a643-f5dea8e1ca66 req-51fc7ccc-6c7d-4c03-b5a7-aca0f0e6393a service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:00 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-a48d25e4-edfc-4472-a643-f5dea8e1ca66 req-51fc7ccc-6c7d-4c03-b5a7-aca0f0e6393a service nova] Creating event network-vif-deleted:0099c8b1-71b7-45a0-abe2-aeecf2e3e73b for instance 4fae3aae-cb67-4c14-b358-59248d99238d on user Apr 19 08:05:00 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-a48d25e4-edfc-4472-a643-f5dea8e1ca66 req-51fc7ccc-6c7d-4c03-b5a7-aca0f0e6393a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031616 Apr 19 08:05:00 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 80/238] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:05:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:05:13 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-e5e2a180-6e77-4cef-923f-43759f1a76f7 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:05:13 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-e5e2a180-6e77-4cef-923f-43759f1a76f7 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] [instance: 02f0e5d6-1c4e-4549-8991-9dfcea958ac2] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:05:13 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:05:13 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=8 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:05:13 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=8 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:05:13 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e5e2a180-6e77-4cef-923f-43759f1a76f7 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:13 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e5e2a180-6e77-4cef-923f-43759f1a76f7 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:13 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e5e2a180-6e77-4cef-923f-43759f1a76f7 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:13 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e5e2a180-6e77-4cef-923f-43759f1a76f7 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:13 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e5e2a180-6e77-4cef-923f-43759f1a76f7 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:13 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e5e2a180-6e77-4cef-923f-43759f1a76f7 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:13 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-e5e2a180-6e77-4cef-923f-43759f1a76f7 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32cbfb3d854d56ad3961da3f406e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8362c8d404717b2fa6e510f1de07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:05:13 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-e5e2a180-6e77-4cef-923f-43759f1a76f7 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02f0e5d6-1c4e-4549-8991-9dfcea958ac2" status: 200 len: 1537 microversion: 2.1 time: 0.220068 Apr 19 08:05:13 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 79/239] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:05:13 2023] GET /compute/v2.1/servers/02f0e5d6-1c4e-4549-8991-9dfcea958ac2 => generated 1537 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:05:13 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=6 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:05:13 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=6 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:05:13 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-adab2dac-4f2f-4602-b95d-94ef3efbff7d tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:05:13 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-adab2dac-4f2f-4602-b95d-94ef3efbff7d tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3d32cbfb3d854d56ad3961da3f406e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8362c8d404717b2fa6e510f1de07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:05:13 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-adab2dac-4f2f-4602-b95d-94ef3efbff7d tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Searching by: {'deleted': False, 'project_id': 'd5e8362c8d404717b2fa6e510f1de07a'} {{(pid=61210) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 19 08:05:13 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-adab2dac-4f2f-4602-b95d-94ef3efbff7d tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:13 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-adab2dac-4f2f-4602-b95d-94ef3efbff7d tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:13 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-adab2dac-4f2f-4602-b95d-94ef3efbff7d tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:13 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-adab2dac-4f2f-4602-b95d-94ef3efbff7d tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:13 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-adab2dac-4f2f-4602-b95d-94ef3efbff7d tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:13 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-adab2dac-4f2f-4602-b95d-94ef3efbff7d tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:13 user devstack@n-api.service[61210]: DEBUG nova.compute.multi_cell_list [None req-adab2dac-4f2f-4602-b95d-94ef3efbff7d tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61210) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 19 08:05:14 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-adab2dac-4f2f-4602-b95d-94ef3efbff7d tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.195369 Apr 19 08:05:14 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 81/240] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 19 08:05:13 2023] GET /compute/v2.1/servers => generated 341 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:05:14 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:05:14 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:05:14 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-3b2cb59a-b131-4f09-882f-8d8a8062caf7 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:05:14 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-3b2cb59a-b131-4f09-882f-8d8a8062caf7 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] [instance: 02f0e5d6-1c4e-4549-8991-9dfcea958ac2] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:05:14 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-3b2cb59a-b131-4f09-882f-8d8a8062caf7 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:14 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-3b2cb59a-b131-4f09-882f-8d8a8062caf7 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:14 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-3b2cb59a-b131-4f09-882f-8d8a8062caf7 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:14 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-3b2cb59a-b131-4f09-882f-8d8a8062caf7 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:14 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-3b2cb59a-b131-4f09-882f-8d8a8062caf7 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:14 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-3b2cb59a-b131-4f09-882f-8d8a8062caf7 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:14 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-3b2cb59a-b131-4f09-882f-8d8a8062caf7 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32cbfb3d854d56ad3961da3f406e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8362c8d404717b2fa6e510f1de07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:05:14 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-3b2cb59a-b131-4f09-882f-8d8a8062caf7 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02f0e5d6-1c4e-4549-8991-9dfcea958ac2" status: 200 len: 1537 microversion: 2.1 time: 0.254752 Apr 19 08:05:14 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 81/241] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:05:14 2023] GET /compute/v2.1/servers/02f0e5d6-1c4e-4549-8991-9dfcea958ac2 => generated 1537 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:05:15 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-018194b3-f35e-40ee-9715-0845968be643 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:05:15 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-018194b3-f35e-40ee-9715-0845968be643 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] [instance: 02f0e5d6-1c4e-4549-8991-9dfcea958ac2] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:05:15 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-018194b3-f35e-40ee-9715-0845968be643 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:15 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-018194b3-f35e-40ee-9715-0845968be643 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:15 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-018194b3-f35e-40ee-9715-0845968be643 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:15 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-018194b3-f35e-40ee-9715-0845968be643 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:15 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-018194b3-f35e-40ee-9715-0845968be643 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:15 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-018194b3-f35e-40ee-9715-0845968be643 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:15 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-018194b3-f35e-40ee-9715-0845968be643 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] [instance: 02f0e5d6-1c4e-4549-8991-9dfcea958ac2] Going to try to terminate instance {{(pid=61209) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:05:15 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-018194b3-f35e-40ee-9715-0845968be643 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/02f0e5d6-1c4e-4549-8991-9dfcea958ac2" status: 204 len: 0 microversion: 2.1 time: 0.124870 Apr 19 08:05:15 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 80/242] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:05:15 2023] DELETE /compute/v2.1/servers/02f0e5d6-1c4e-4549-8991-9dfcea958ac2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 08:05:15 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-f081ef97-5ac3-48c4-9140-f46c942f10c2 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:05:15 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-f081ef97-5ac3-48c4-9140-f46c942f10c2 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] [instance: 02f0e5d6-1c4e-4549-8991-9dfcea958ac2] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:05:15 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f081ef97-5ac3-48c4-9140-f46c942f10c2 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:15 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f081ef97-5ac3-48c4-9140-f46c942f10c2 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:15 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f081ef97-5ac3-48c4-9140-f46c942f10c2 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:15 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f081ef97-5ac3-48c4-9140-f46c942f10c2 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:15 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f081ef97-5ac3-48c4-9140-f46c942f10c2 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:15 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f081ef97-5ac3-48c4-9140-f46c942f10c2 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:16 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-f081ef97-5ac3-48c4-9140-f46c942f10c2 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d32cbfb3d854d56ad3961da3f406e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8362c8d404717b2fa6e510f1de07a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:05:16 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-f081ef97-5ac3-48c4-9140-f46c942f10c2 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02f0e5d6-1c4e-4549-8991-9dfcea958ac2" status: 200 len: 1543 microversion: 2.1 time: 0.322650 Apr 19 08:05:16 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 82/243] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:05:15 2023] GET /compute/v2.1/servers/02f0e5d6-1c4e-4549-8991-9dfcea958ac2 => generated 1543 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:05:16 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-e53ec232-9602-4d6f-a11d-b462744e3ef1 req-fab994a2-862e-4283-aeb0-7411be1123b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f0e5d6-1c4e-4549-8991-9dfcea958ac2", "name": "network-vif-unplugged", "status": "completed", "tag": "56567141-0a44-48a8-9388-4f4804539616"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:05:16 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-e53ec232-9602-4d6f-a11d-b462744e3ef1 req-fab994a2-862e-4283-aeb0-7411be1123b5 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:16 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-e53ec232-9602-4d6f-a11d-b462744e3ef1 req-fab994a2-862e-4283-aeb0-7411be1123b5 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:16 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-e53ec232-9602-4d6f-a11d-b462744e3ef1 req-fab994a2-862e-4283-aeb0-7411be1123b5 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:16 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-e53ec232-9602-4d6f-a11d-b462744e3ef1 req-fab994a2-862e-4283-aeb0-7411be1123b5 service nova] Creating event network-vif-unplugged:56567141-0a44-48a8-9388-4f4804539616 for instance 02f0e5d6-1c4e-4549-8991-9dfcea958ac2 on user Apr 19 08:05:16 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-e53ec232-9602-4d6f-a11d-b462744e3ef1 req-fab994a2-862e-4283-aeb0-7411be1123b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079679 Apr 19 08:05:16 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 82/244] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:05:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:05:17 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-dfca35c1-636f-4ef0-b754-88d9215f8176 req-d8416850-afc1-4194-9470-d85c6390446c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f0e5d6-1c4e-4549-8991-9dfcea958ac2", "name": "network-vif-deleted", "tag": "56567141-0a44-48a8-9388-4f4804539616"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:05:17 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-dfca35c1-636f-4ef0-b754-88d9215f8176 req-d8416850-afc1-4194-9470-d85c6390446c service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:17 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-dfca35c1-636f-4ef0-b754-88d9215f8176 req-d8416850-afc1-4194-9470-d85c6390446c service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:17 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-dfca35c1-636f-4ef0-b754-88d9215f8176 req-d8416850-afc1-4194-9470-d85c6390446c service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:17 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-dfca35c1-636f-4ef0-b754-88d9215f8176 req-d8416850-afc1-4194-9470-d85c6390446c service nova] Creating event network-vif-deleted:56567141-0a44-48a8-9388-4f4804539616 for instance 02f0e5d6-1c4e-4549-8991-9dfcea958ac2 on user Apr 19 08:05:17 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-dfca35c1-636f-4ef0-b754-88d9215f8176 req-d8416850-afc1-4194-9470-d85c6390446c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028445 Apr 19 08:05:17 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 81/245] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:05:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:05:18 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-425f65ae-000b-4669-8430-aef5964e85a0 req-da859193-8e14-475c-b17b-01b9dc3128d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f0e5d6-1c4e-4549-8991-9dfcea958ac2", "name": "network-vif-plugged", "status": "completed", "tag": "56567141-0a44-48a8-9388-4f4804539616"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:05:18 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-425f65ae-000b-4669-8430-aef5964e85a0 req-da859193-8e14-475c-b17b-01b9dc3128d5 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:18 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-425f65ae-000b-4669-8430-aef5964e85a0 req-da859193-8e14-475c-b17b-01b9dc3128d5 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:18 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-425f65ae-000b-4669-8430-aef5964e85a0 req-da859193-8e14-475c-b17b-01b9dc3128d5 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:18 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-425f65ae-000b-4669-8430-aef5964e85a0 req-da859193-8e14-475c-b17b-01b9dc3128d5 service nova] Creating event network-vif-plugged:56567141-0a44-48a8-9388-4f4804539616 for instance 02f0e5d6-1c4e-4549-8991-9dfcea958ac2 on user Apr 19 08:05:18 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-425f65ae-000b-4669-8430-aef5964e85a0 req-da859193-8e14-475c-b17b-01b9dc3128d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029272 Apr 19 08:05:18 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 83/246] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:05:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:05:22 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-4236bc2e-a905-4389-984c-b41d2c440048 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:05:22 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-4236bc2e-a905-4389-984c-b41d2c440048 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] [instance: 2aa7cbc5-8b78-4631-a906-af3b4a63570a] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:05:22 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4236bc2e-a905-4389-984c-b41d2c440048 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:22 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4236bc2e-a905-4389-984c-b41d2c440048 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:22 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4236bc2e-a905-4389-984c-b41d2c440048 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:22 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4236bc2e-a905-4389-984c-b41d2c440048 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:22 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4236bc2e-a905-4389-984c-b41d2c440048 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:22 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4236bc2e-a905-4389-984c-b41d2c440048 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:23 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-4236bc2e-a905-4389-984c-b41d2c440048 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aa7cbc5-8b78-4631-a906-af3b4a63570a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.191549 Apr 19 08:05:23 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 83/247] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 08:05:22 2023] GET /compute/v2.1/servers/2aa7cbc5-8b78-4631-a906-af3b4a63570a/os-interface => generated 282 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:05:23 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-99a66539-d0bd-4945-b02a-92d883f84ed7 req-63e90fd3-4e5c-414a-9cf5-3001db2f9181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa7cbc5-8b78-4631-a906-af3b4a63570a", "tag": "0791bbd2-9560-4bb3-8689-76793f8ac5c0"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:05:23 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-99a66539-d0bd-4945-b02a-92d883f84ed7 req-63e90fd3-4e5c-414a-9cf5-3001db2f9181 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:23 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-99a66539-d0bd-4945-b02a-92d883f84ed7 req-63e90fd3-4e5c-414a-9cf5-3001db2f9181 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:23 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-99a66539-d0bd-4945-b02a-92d883f84ed7 req-63e90fd3-4e5c-414a-9cf5-3001db2f9181 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:23 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-99a66539-d0bd-4945-b02a-92d883f84ed7 req-63e90fd3-4e5c-414a-9cf5-3001db2f9181 service nova] Creating event network-changed:0791bbd2-9560-4bb3-8689-76793f8ac5c0 for instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a on user Apr 19 08:05:23 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-99a66539-d0bd-4945-b02a-92d883f84ed7 req-63e90fd3-4e5c-414a-9cf5-3001db2f9181 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034078 Apr 19 08:05:23 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 82/248] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:05:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:05:23 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-a91c0684-1872-4811-a210-c62656bb4743 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:05:23 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-a91c0684-1872-4811-a210-c62656bb4743 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] [instance: 2aa7cbc5-8b78-4631-a906-af3b4a63570a] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:05:23 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a91c0684-1872-4811-a210-c62656bb4743 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:23 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a91c0684-1872-4811-a210-c62656bb4743 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:23 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a91c0684-1872-4811-a210-c62656bb4743 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:23 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a91c0684-1872-4811-a210-c62656bb4743 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:23 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a91c0684-1872-4811-a210-c62656bb4743 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:23 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a91c0684-1872-4811-a210-c62656bb4743 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:23 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-a91c0684-1872-4811-a210-c62656bb4743 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aa7cbc5-8b78-4631-a906-af3b4a63570a/ips" status: 200 len: 104 microversion: 2.1 time: 0.032777 Apr 19 08:05:23 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 84/249] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 08:05:23 2023] GET /compute/v2.1/servers/2aa7cbc5-8b78-4631-a906-af3b4a63570a/ips => generated 104 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:05:25 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-9587c488-6c46-4308-aee1-4fdbc3160798 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:05:25 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-9587c488-6c46-4308-aee1-4fdbc3160798 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] [instance: 2aa7cbc5-8b78-4631-a906-af3b4a63570a] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:05:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-9587c488-6c46-4308-aee1-4fdbc3160798 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-9587c488-6c46-4308-aee1-4fdbc3160798 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-9587c488-6c46-4308-aee1-4fdbc3160798 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-9587c488-6c46-4308-aee1-4fdbc3160798 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-9587c488-6c46-4308-aee1-4fdbc3160798 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-9587c488-6c46-4308-aee1-4fdbc3160798 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:25 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-9587c488-6c46-4308-aee1-4fdbc3160798 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] [instance: 2aa7cbc5-8b78-4631-a906-af3b4a63570a] Going to try to terminate instance {{(pid=61208) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:05:25 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-9587c488-6c46-4308-aee1-4fdbc3160798 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2aa7cbc5-8b78-4631-a906-af3b4a63570a" status: 204 len: 0 microversion: 2.1 time: 0.123883 Apr 19 08:05:25 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 84/250] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:05:25 2023] DELETE /compute/v2.1/servers/2aa7cbc5-8b78-4631-a906-af3b4a63570a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 08:05:25 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-b7dd415e-b650-47a5-bafd-7b1d204b1e5a tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:05:25 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-b7dd415e-b650-47a5-bafd-7b1d204b1e5a tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] [instance: 2aa7cbc5-8b78-4631-a906-af3b4a63570a] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:05:25 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b7dd415e-b650-47a5-bafd-7b1d204b1e5a tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:25 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b7dd415e-b650-47a5-bafd-7b1d204b1e5a tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:25 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b7dd415e-b650-47a5-bafd-7b1d204b1e5a tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:25 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b7dd415e-b650-47a5-bafd-7b1d204b1e5a tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:25 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b7dd415e-b650-47a5-bafd-7b1d204b1e5a tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:25 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b7dd415e-b650-47a5-bafd-7b1d204b1e5a tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:25 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell0:SELECT=2 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:05:25 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-918a64a7-aa64-470a-a6ee-8773bb4161d4 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:05:25 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-918a64a7-aa64-470a-a6ee-8773bb4161d4 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] [instance: a36b83d3-7114-49dc-9632-48c0dacafbf8] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:05:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-918a64a7-aa64-470a-a6ee-8773bb4161d4 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-918a64a7-aa64-470a-a6ee-8773bb4161d4 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-918a64a7-aa64-470a-a6ee-8773bb4161d4 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-918a64a7-aa64-470a-a6ee-8773bb4161d4 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-918a64a7-aa64-470a-a6ee-8773bb4161d4 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-918a64a7-aa64-470a-a6ee-8773bb4161d4 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:25 user devstack@n-api.service[61210]: INFO nova.api.openstack.wsgi [None req-918a64a7-aa64-470a-a6ee-8773bb4161d4 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] HTTP exception thrown: Instance a36b83d3-7114-49dc-9632-48c0dacafbf8 could not be found. Apr 19 08:05:25 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-918a64a7-aa64-470a-a6ee-8773bb4161d4 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Request method failure captured: Apr 19 08:05:25 user devstack@n-api.service[61210]: request: GET /compute/v2.1/servers/a36b83d3-7114-49dc-9632-48c0dacafbf8 HTTP/1.1 Apr 19 08:05:25 user devstack@n-api.service[61210]: Accept: application/json Apr 19 08:05:25 user devstack@n-api.service[61210]: Accept-Encoding: identity Apr 19 08:05:25 user devstack@n-api.service[61210]: Connection: close Apr 19 08:05:25 user devstack@n-api.service[61210]: Content-Length: 0 Apr 19 08:05:25 user devstack@n-api.service[61210]: Content-Type: application/json Apr 19 08:05:25 user devstack@n-api.service[61210]: Host: 10.0.0.210 Apr 19 08:05:25 user devstack@n-api.service[61210]: Openstack-System-Scope: None Apr 19 08:05:25 user devstack@n-api.service[61210]: User-Agent: python-urllib3/1.26.15 Apr 19 08:05:25 user devstack@n-api.service[61210]: X-Auth-Token: gAAAAABkP59xNTwhlAAAA2JujT-wo_l2ufuMV8sTTMDaFIGwuGfsQbRJUCZbxTUji78sJUAoKHBI9AYyV5Ld-YVfxFM12oBsiXjUQFlV1dJufG6HK5Q9kwR6qTq9ERFwo-wsxZEkpFB3mL9F4bjFKrUbr6tCW8rQ4EIA5NnGDxvwWSN4nYEKJUk Apr 19 08:05:25 user devstack@n-api.service[61210]: X-Domain-Id: None Apr 19 08:05:25 user devstack@n-api.service[61210]: X-Domain-Name: None Apr 19 08:05:25 user devstack@n-api.service[61210]: X-Identity-Status: Confirmed Apr 19 08:05:25 user devstack@n-api.service[61210]: X-Is-Admin-Project: True Apr 19 08:05:25 user devstack@n-api.service[61210]: X-Project-Domain-Id: default Apr 19 08:05:25 user devstack@n-api.service[61210]: X-Project-Domain-Name: Default Apr 19 08:05:25 user devstack@n-api.service[61210]: X-Project-Id: 173f7e00d8f748debe5a126203220f7f Apr 19 08:05:25 user devstack@n-api.service[61210]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-175442756 Apr 19 08:05:25 user devstack@n-api.service[61210]: X-Role: reader,member Apr 19 08:05:25 user devstack@n-api.service[61210]: X-Roles: reader,member Apr 19 08:05:25 user devstack@n-api.service[61210]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/173f7e00d8f748debe5a126203220f7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/173f7e00d8f748debe5a126203220f7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/173f7e00d8f748debe5a126203220f7f"}]}] Apr 19 08:05:25 user devstack@n-api.service[61210]: X-Tenant: tempest-ServerRescueNegativeTestJSON-175442756 Apr 19 08:05:25 user devstack@n-api.service[61210]: X-Tenant-Id: 173f7e00d8f748debe5a126203220f7f Apr 19 08:05:25 user devstack@n-api.service[61210]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-175442756 Apr 19 08:05:25 user devstack@n-api.service[61210]: X-User: tempest-ServerRescueNegativeTestJSON-175442756-project-member Apr 19 08:05:25 user devstack@n-api.service[61210]: X-User-Domain-Id: default Apr 19 08:05:25 user devstack@n-api.service[61210]: X-User-Domain-Name: Default Apr 19 08:05:25 user devstack@n-api.service[61210]: X-User-Id: e9796d2c200d4419b0fe67d541efc8f4 Apr 19 08:05:25 user devstack@n-api.service[61210]: X-User-Name: tempest-ServerRescueNegativeTestJSON-175442756-project-member Apr 19 08:05:25 user devstack@n-api.service[61210]: method: > Apr 19 08:05:25 user devstack@n-api.service[61210]: exception: Instance a36b83d3-7114-49dc-9632-48c0dacafbf8 could not be found. Apr 19 08:05:25 user devstack@n-api.service[61210]: action_args: {'id': 'a36b83d3-7114-49dc-9632-48c0dacafbf8'} Apr 19 08:05:25 user devstack@n-api.service[61210]: {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a36b83d3-7114-49dc-9632-48c0dacafbf8 could not be found. Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a36b83d3-7114-49dc-9632-48c0dacafbf8 could not be found. Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a36b83d3-7114-49dc-9632-48c0dacafbf8 could not be found. Apr 19 08:05:25 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:05:25 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-918a64a7-aa64-470a-a6ee-8773bb4161d4 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Returning 404 to user: Instance a36b83d3-7114-49dc-9632-48c0dacafbf8 could not be found. {{(pid=61210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:05:25 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-918a64a7-aa64-470a-a6ee-8773bb4161d4 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a36b83d3-7114-49dc-9632-48c0dacafbf8" status: 404 len: 111 microversion: 2.1 time: 0.152888 Apr 19 08:05:25 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 85/251] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:05:25 2023] GET /compute/v2.1/servers/a36b83d3-7114-49dc-9632-48c0dacafbf8 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:05:25 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-2e8ef0e6-aa91-4223-9d4e-4efb83d843f5 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:05:25 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-2e8ef0e6-aa91-4223-9d4e-4efb83d843f5 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] [instance: f3504e30-9be0-40b5-a53c-859dadad53a1] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:05:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-2e8ef0e6-aa91-4223-9d4e-4efb83d843f5 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-2e8ef0e6-aa91-4223-9d4e-4efb83d843f5 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-2e8ef0e6-aa91-4223-9d4e-4efb83d843f5 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-2e8ef0e6-aa91-4223-9d4e-4efb83d843f5 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-2e8ef0e6-aa91-4223-9d4e-4efb83d843f5 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-2e8ef0e6-aa91-4223-9d4e-4efb83d843f5 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:25 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-2e8ef0e6-aa91-4223-9d4e-4efb83d843f5 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] [instance: f3504e30-9be0-40b5-a53c-859dadad53a1] Going to try to terminate instance {{(pid=61208) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:05:25 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-b7dd415e-b650-47a5-bafd-7b1d204b1e5a tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64f18935b0524876bf69f22cff03139a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d73100ea55541d08952a24ef6931a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:05:25 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-b7dd415e-b650-47a5-bafd-7b1d204b1e5a tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aa7cbc5-8b78-4631-a906-af3b4a63570a" status: 200 len: 1663 microversion: 2.1 time: 0.360150 Apr 19 08:05:25 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 83/252] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:05:25 2023] GET /compute/v2.1/servers/2aa7cbc5-8b78-4631-a906-af3b4a63570a => generated 1663 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:05:25 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-77607f3a-0edd-4f08-9b93-5ff1303d62a3 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:05:25 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-77607f3a-0edd-4f08-9b93-5ff1303d62a3 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] [instance: bb5de453-e849-4495-8e25-6d3b0e8c3569] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:05:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-77607f3a-0edd-4f08-9b93-5ff1303d62a3 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-77607f3a-0edd-4f08-9b93-5ff1303d62a3 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-77607f3a-0edd-4f08-9b93-5ff1303d62a3 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-77607f3a-0edd-4f08-9b93-5ff1303d62a3 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-77607f3a-0edd-4f08-9b93-5ff1303d62a3 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-77607f3a-0edd-4f08-9b93-5ff1303d62a3 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:25 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-2e8ef0e6-aa91-4223-9d4e-4efb83d843f5 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f3504e30-9be0-40b5-a53c-859dadad53a1" status: 204 len: 0 microversion: 2.1 time: 0.233430 Apr 19 08:05:25 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 85/253] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:05:25 2023] DELETE /compute/v2.1/servers/f3504e30-9be0-40b5-a53c-859dadad53a1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 08:05:25 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-f96f5d4c-fadb-4924-91a0-3a8494861a7f tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:05:25 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-f96f5d4c-fadb-4924-91a0-3a8494861a7f tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] [instance: f3504e30-9be0-40b5-a53c-859dadad53a1] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:05:25 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-f96f5d4c-fadb-4924-91a0-3a8494861a7f tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:25 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-f96f5d4c-fadb-4924-91a0-3a8494861a7f tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:25 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-f96f5d4c-fadb-4924-91a0-3a8494861a7f tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:25 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-f96f5d4c-fadb-4924-91a0-3a8494861a7f tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:25 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-f96f5d4c-fadb-4924-91a0-3a8494861a7f tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:25 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-f96f5d4c-fadb-4924-91a0-3a8494861a7f tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:25 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-83639632-705c-480e-b225-64f52095b1a5 req-c8673da2-829e-4264-9e1b-b567267288e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa7cbc5-8b78-4631-a906-af3b4a63570a", "name": "network-vif-unplugged", "status": "completed", "tag": "0791bbd2-9560-4bb3-8689-76793f8ac5c0"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:05:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-83639632-705c-480e-b225-64f52095b1a5 req-c8673da2-829e-4264-9e1b-b567267288e8 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-83639632-705c-480e-b225-64f52095b1a5 req-c8673da2-829e-4264-9e1b-b567267288e8 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-83639632-705c-480e-b225-64f52095b1a5 req-c8673da2-829e-4264-9e1b-b567267288e8 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:25 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-83639632-705c-480e-b225-64f52095b1a5 req-c8673da2-829e-4264-9e1b-b567267288e8 service nova] Creating event network-vif-unplugged:0791bbd2-9560-4bb3-8689-76793f8ac5c0 for instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a on user Apr 19 08:05:25 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-83639632-705c-480e-b225-64f52095b1a5 req-c8673da2-829e-4264-9e1b-b567267288e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066589 Apr 19 08:05:25 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 86/254] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:05:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:05:25 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-77607f3a-0edd-4f08-9b93-5ff1303d62a3 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8043565b02bb4f63b4a0b552b7191098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f06d44ee43138f373093d40014fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:05:25 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-77607f3a-0edd-4f08-9b93-5ff1303d62a3 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb5de453-e849-4495-8e25-6d3b0e8c3569" status: 200 len: 1568 microversion: 2.1 time: 0.317349 Apr 19 08:05:25 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 86/255] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:05:25 2023] GET /compute/v2.1/servers/bb5de453-e849-4495-8e25-6d3b0e8c3569 => generated 1568 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:05:26 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-cf16f04b-edbe-48c9-b1f7-a3e4dd144245 req-f921c380-5b87-47dd-a161-b308c3df24c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3504e30-9be0-40b5-a53c-859dadad53a1", "name": "network-vif-unplugged", "status": "completed", "tag": "f15126e6-928c-4edf-ad46-3ad97be876be"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:05:26 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-f96f5d4c-fadb-4924-91a0-3a8494861a7f tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9796d2c200d4419b0fe67d541efc8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173f7e00d8f748debe5a126203220f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:05:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-cf16f04b-edbe-48c9-b1f7-a3e4dd144245 req-f921c380-5b87-47dd-a161-b308c3df24c2 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-cf16f04b-edbe-48c9-b1f7-a3e4dd144245 req-f921c380-5b87-47dd-a161-b308c3df24c2 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-cf16f04b-edbe-48c9-b1f7-a3e4dd144245 req-f921c380-5b87-47dd-a161-b308c3df24c2 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:26 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-f96f5d4c-fadb-4924-91a0-3a8494861a7f tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3504e30-9be0-40b5-a53c-859dadad53a1" status: 200 len: 1509 microversion: 2.1 time: 0.309258 Apr 19 08:05:26 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 84/256] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:05:25 2023] GET /compute/v2.1/servers/f3504e30-9be0-40b5-a53c-859dadad53a1 => generated 1509 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:05:26 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-cf16f04b-edbe-48c9-b1f7-a3e4dd144245 req-f921c380-5b87-47dd-a161-b308c3df24c2 service nova] Creating event network-vif-unplugged:f15126e6-928c-4edf-ad46-3ad97be876be for instance f3504e30-9be0-40b5-a53c-859dadad53a1 on user Apr 19 08:05:26 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-cf16f04b-edbe-48c9-b1f7-a3e4dd144245 req-f921c380-5b87-47dd-a161-b308c3df24c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049848 Apr 19 08:05:26 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 87/257] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:05:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:05:26 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-ed9749a9-4911-4cd4-a2d4-a7d07a600bea req-3946d898-9bcf-4317-8a00-8af1e7a7af83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa7cbc5-8b78-4631-a906-af3b4a63570a", "name": "network-vif-deleted", "tag": "0791bbd2-9560-4bb3-8689-76793f8ac5c0"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:05:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-ed9749a9-4911-4cd4-a2d4-a7d07a600bea req-3946d898-9bcf-4317-8a00-8af1e7a7af83 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-ed9749a9-4911-4cd4-a2d4-a7d07a600bea req-3946d898-9bcf-4317-8a00-8af1e7a7af83 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-ed9749a9-4911-4cd4-a2d4-a7d07a600bea req-3946d898-9bcf-4317-8a00-8af1e7a7af83 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:26 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-ed9749a9-4911-4cd4-a2d4-a7d07a600bea req-3946d898-9bcf-4317-8a00-8af1e7a7af83 service nova] Creating event network-vif-deleted:0791bbd2-9560-4bb3-8689-76793f8ac5c0 for instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a on user Apr 19 08:05:26 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-ed9749a9-4911-4cd4-a2d4-a7d07a600bea req-3946d898-9bcf-4317-8a00-8af1e7a7af83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029068 Apr 19 08:05:26 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 87/258] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:05:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:05:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-b9b0dbaf-32a8-44ad-95d5-69e1865e4570 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:05:27 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-b9b0dbaf-32a8-44ad-95d5-69e1865e4570 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] [instance: bb5de453-e849-4495-8e25-6d3b0e8c3569] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:05:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b9b0dbaf-32a8-44ad-95d5-69e1865e4570 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b9b0dbaf-32a8-44ad-95d5-69e1865e4570 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b9b0dbaf-32a8-44ad-95d5-69e1865e4570 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b9b0dbaf-32a8-44ad-95d5-69e1865e4570 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b9b0dbaf-32a8-44ad-95d5-69e1865e4570 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b9b0dbaf-32a8-44ad-95d5-69e1865e4570 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:27 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-b9b0dbaf-32a8-44ad-95d5-69e1865e4570 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] [instance: bb5de453-e849-4495-8e25-6d3b0e8c3569] Going to try to terminate instance {{(pid=61209) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:05:27 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-b9b0dbaf-32a8-44ad-95d5-69e1865e4570 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bb5de453-e849-4495-8e25-6d3b0e8c3569" status: 204 len: 0 microversion: 2.1 time: 0.117957 Apr 19 08:05:27 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 85/259] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:05:27 2023] DELETE /compute/v2.1/servers/bb5de453-e849-4495-8e25-6d3b0e8c3569 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 08:05:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-09e6640d-5c2a-4af9-8519-6982af46dc26 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:05:27 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-09e6640d-5c2a-4af9-8519-6982af46dc26 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] [instance: bb5de453-e849-4495-8e25-6d3b0e8c3569] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:05:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-09e6640d-5c2a-4af9-8519-6982af46dc26 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-09e6640d-5c2a-4af9-8519-6982af46dc26 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-09e6640d-5c2a-4af9-8519-6982af46dc26 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-09e6640d-5c2a-4af9-8519-6982af46dc26 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-09e6640d-5c2a-4af9-8519-6982af46dc26 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-09e6640d-5c2a-4af9-8519-6982af46dc26 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-0e4def27-7f07-4974-a60a-db0dee5482a0 req-4b7cd017-ee67-44cd-b325-565fde4e7408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa7cbc5-8b78-4631-a906-af3b4a63570a", "name": "network-vif-plugged", "status": "completed", "tag": "0791bbd2-9560-4bb3-8689-76793f8ac5c0"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:05:27 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-0e4def27-7f07-4974-a60a-db0dee5482a0 req-4b7cd017-ee67-44cd-b325-565fde4e7408 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:27 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-0e4def27-7f07-4974-a60a-db0dee5482a0 req-4b7cd017-ee67-44cd-b325-565fde4e7408 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:27 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-0e4def27-7f07-4974-a60a-db0dee5482a0 req-4b7cd017-ee67-44cd-b325-565fde4e7408 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:27 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-0e4def27-7f07-4974-a60a-db0dee5482a0 req-4b7cd017-ee67-44cd-b325-565fde4e7408 service nova] Creating event network-vif-plugged:0791bbd2-9560-4bb3-8689-76793f8ac5c0 for instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a on user Apr 19 08:05:27 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-0e4def27-7f07-4974-a60a-db0dee5482a0 req-4b7cd017-ee67-44cd-b325-565fde4e7408 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030506 Apr 19 08:05:27 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 88/260] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:05:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:05:27 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-09e6640d-5c2a-4af9-8519-6982af46dc26 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8043565b02bb4f63b4a0b552b7191098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f06d44ee43138f373093d40014fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:05:27 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-09e6640d-5c2a-4af9-8519-6982af46dc26 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb5de453-e849-4495-8e25-6d3b0e8c3569" status: 200 len: 1574 microversion: 2.1 time: 0.273022 Apr 19 08:05:27 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 88/261] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:05:27 2023] GET /compute/v2.1/servers/bb5de453-e849-4495-8e25-6d3b0e8c3569 => generated 1574 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:05:28 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-1610cdb4-a748-4897-b145-dcf88bcd5c02 req-d5bf39a9-69ee-44cd-9c8e-42bbac1f75d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3504e30-9be0-40b5-a53c-859dadad53a1", "name": "network-vif-plugged", "status": "completed", "tag": "f15126e6-928c-4edf-ad46-3ad97be876be"}, {"server_uuid": "f3504e30-9be0-40b5-a53c-859dadad53a1", "name": "network-vif-deleted", "tag": "f15126e6-928c-4edf-ad46-3ad97be876be"}, {"server_uuid": "bb5de453-e849-4495-8e25-6d3b0e8c3569", "name": "network-vif-unplugged", "status": "completed", "tag": "1f650f36-60e3-4ddb-bb93-facba325d15f"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:05:28 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-1610cdb4-a748-4897-b145-dcf88bcd5c02 req-d5bf39a9-69ee-44cd-9c8e-42bbac1f75d6 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:28 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-1610cdb4-a748-4897-b145-dcf88bcd5c02 req-d5bf39a9-69ee-44cd-9c8e-42bbac1f75d6 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:28 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-1610cdb4-a748-4897-b145-dcf88bcd5c02 req-d5bf39a9-69ee-44cd-9c8e-42bbac1f75d6 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:28 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-1610cdb4-a748-4897-b145-dcf88bcd5c02 req-d5bf39a9-69ee-44cd-9c8e-42bbac1f75d6 service nova] Creating event network-vif-plugged:f15126e6-928c-4edf-ad46-3ad97be876be for instance f3504e30-9be0-40b5-a53c-859dadad53a1 on user Apr 19 08:05:28 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-1610cdb4-a748-4897-b145-dcf88bcd5c02 req-d5bf39a9-69ee-44cd-9c8e-42bbac1f75d6 service nova] Creating event network-vif-deleted:f15126e6-928c-4edf-ad46-3ad97be876be for instance f3504e30-9be0-40b5-a53c-859dadad53a1 on user Apr 19 08:05:28 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-1610cdb4-a748-4897-b145-dcf88bcd5c02 req-d5bf39a9-69ee-44cd-9c8e-42bbac1f75d6 service nova] Creating event network-vif-unplugged:1f650f36-60e3-4ddb-bb93-facba325d15f for instance bb5de453-e849-4495-8e25-6d3b0e8c3569 on user Apr 19 08:05:28 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-1610cdb4-a748-4897-b145-dcf88bcd5c02 req-d5bf39a9-69ee-44cd-9c8e-42bbac1f75d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.033212 Apr 19 08:05:28 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 86/262] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:05:28 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:05:30 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-5b731172-636a-4163-89e1-495f759090e6 req-e0fe97f4-e316-4c01-b380-25a2734f62fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb5de453-e849-4495-8e25-6d3b0e8c3569", "name": "network-vif-plugged", "status": "completed", "tag": "1f650f36-60e3-4ddb-bb93-facba325d15f"}, {"server_uuid": "bb5de453-e849-4495-8e25-6d3b0e8c3569", "name": "network-vif-deleted", "tag": "1f650f36-60e3-4ddb-bb93-facba325d15f"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:05:30 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-5b731172-636a-4163-89e1-495f759090e6 req-e0fe97f4-e316-4c01-b380-25a2734f62fd service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:30 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-5b731172-636a-4163-89e1-495f759090e6 req-e0fe97f4-e316-4c01-b380-25a2734f62fd service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:30 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-5b731172-636a-4163-89e1-495f759090e6 req-e0fe97f4-e316-4c01-b380-25a2734f62fd service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:30 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-5b731172-636a-4163-89e1-495f759090e6 req-e0fe97f4-e316-4c01-b380-25a2734f62fd service nova] Creating event network-vif-plugged:1f650f36-60e3-4ddb-bb93-facba325d15f for instance bb5de453-e849-4495-8e25-6d3b0e8c3569 on user Apr 19 08:05:30 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-5b731172-636a-4163-89e1-495f759090e6 req-e0fe97f4-e316-4c01-b380-25a2734f62fd service nova] Creating event network-vif-deleted:1f650f36-60e3-4ddb-bb93-facba325d15f for instance bb5de453-e849-4495-8e25-6d3b0e8c3569 on user Apr 19 08:05:30 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-5b731172-636a-4163-89e1-495f759090e6 req-e0fe97f4-e316-4c01-b380-25a2734f62fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033443 Apr 19 08:05:30 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 89/263] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:05:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:05:30 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-bf4478de-4e30-41c5-864e-3c2434bf6fb0 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:05:30 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-bf4478de-4e30-41c5-864e-3c2434bf6fb0 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] [instance: bdeeb437-76a3-49b5-9553-d2da74917d69] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:05:30 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-bf4478de-4e30-41c5-864e-3c2434bf6fb0 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:30 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-bf4478de-4e30-41c5-864e-3c2434bf6fb0 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:30 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-bf4478de-4e30-41c5-864e-3c2434bf6fb0 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:30 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-bf4478de-4e30-41c5-864e-3c2434bf6fb0 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:30 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-bf4478de-4e30-41c5-864e-3c2434bf6fb0 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:30 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-bf4478de-4e30-41c5-864e-3c2434bf6fb0 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:30 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-bf4478de-4e30-41c5-864e-3c2434bf6fb0 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dc2a88f2d149a1a4035ed1c7e74b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcde8c2a3444e919d232ea854c00e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:05:30 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-bf4478de-4e30-41c5-864e-3c2434bf6fb0 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69" status: 200 len: 1658 microversion: 2.1 time: 0.575003 Apr 19 08:05:30 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 89/264] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:05:30 2023] GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69 => generated 1658 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:05:30 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-b80ff3cb-a482-4bb2-9b7d-5945bea5b02a tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:05:30 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-b80ff3cb-a482-4bb2-9b7d-5945bea5b02a tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] [instance: bdeeb437-76a3-49b5-9553-d2da74917d69] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:05:30 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b80ff3cb-a482-4bb2-9b7d-5945bea5b02a tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:30 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b80ff3cb-a482-4bb2-9b7d-5945bea5b02a tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:30 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b80ff3cb-a482-4bb2-9b7d-5945bea5b02a tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:30 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b80ff3cb-a482-4bb2-9b7d-5945bea5b02a tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:30 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b80ff3cb-a482-4bb2-9b7d-5945bea5b02a tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:30 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b80ff3cb-a482-4bb2-9b7d-5945bea5b02a tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:31 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-b80ff3cb-a482-4bb2-9b7d-5945bea5b02a tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dc2a88f2d149a1a4035ed1c7e74b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcde8c2a3444e919d232ea854c00e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:05:31 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-b80ff3cb-a482-4bb2-9b7d-5945bea5b02a tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69" status: 200 len: 1658 microversion: 2.1 time: 0.210581 Apr 19 08:05:31 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 87/265] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:05:30 2023] GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69 => generated 1658 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:05:31 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-2541f2b9-8d80-48d6-9afa-b055b846bf02 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:05:31 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-2541f2b9-8d80-48d6-9afa-b055b846bf02 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] [instance: bdeeb437-76a3-49b5-9553-d2da74917d69] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:05:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-2541f2b9-8d80-48d6-9afa-b055b846bf02 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-2541f2b9-8d80-48d6-9afa-b055b846bf02 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-2541f2b9-8d80-48d6-9afa-b055b846bf02 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-2541f2b9-8d80-48d6-9afa-b055b846bf02 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-2541f2b9-8d80-48d6-9afa-b055b846bf02 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-2541f2b9-8d80-48d6-9afa-b055b846bf02 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:31 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-2541f2b9-8d80-48d6-9afa-b055b846bf02 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dc2a88f2d149a1a4035ed1c7e74b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcde8c2a3444e919d232ea854c00e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:05:31 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-2541f2b9-8d80-48d6-9afa-b055b846bf02 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69" status: 200 len: 1658 microversion: 2.1 time: 0.217278 Apr 19 08:05:31 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 90/266] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:05:31 2023] GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69 => generated 1658 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:05:39 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-439b0395-063e-41cb-b70f-b3fb34071a9e tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:05:39 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-439b0395-063e-41cb-b70f-b3fb34071a9e tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] [instance: 266d27ff-db1d-443a-8562-b67a859afe20] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:05:39 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-439b0395-063e-41cb-b70f-b3fb34071a9e tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:39 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-439b0395-063e-41cb-b70f-b3fb34071a9e tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:39 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-439b0395-063e-41cb-b70f-b3fb34071a9e tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:39 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-439b0395-063e-41cb-b70f-b3fb34071a9e tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:39 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-439b0395-063e-41cb-b70f-b3fb34071a9e tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:39 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-439b0395-063e-41cb-b70f-b3fb34071a9e tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:39 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-439b0395-063e-41cb-b70f-b3fb34071a9e tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2027c586717a407baa7cd8f3cdc56459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f98320d1745918cc7e2ca0ddf0ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:05:39 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-439b0395-063e-41cb-b70f-b3fb34071a9e tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/266d27ff-db1d-443a-8562-b67a859afe20" status: 200 len: 1493 microversion: 2.1 time: 0.243882 Apr 19 08:05:39 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 90/267] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:05:39 2023] GET /compute/v2.1/servers/266d27ff-db1d-443a-8562-b67a859afe20 => generated 1493 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:05:47 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:05:47 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:05:47 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-10306a4c-1632-4b4a-a7a4-894ba01c65df tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:05:47 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-10306a4c-1632-4b4a-a7a4-894ba01c65df tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] [instance: 4fae3aae-cb67-4c14-b358-59248d99238d] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:05:47 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-10306a4c-1632-4b4a-a7a4-894ba01c65df tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:47 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-10306a4c-1632-4b4a-a7a4-894ba01c65df tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:47 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-10306a4c-1632-4b4a-a7a4-894ba01c65df tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:47 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-10306a4c-1632-4b4a-a7a4-894ba01c65df tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:05:47 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-10306a4c-1632-4b4a-a7a4-894ba01c65df tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:05:47 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-10306a4c-1632-4b4a-a7a4-894ba01c65df tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:05:47 user devstack@n-api.service[61209]: INFO nova.api.openstack.wsgi [None req-10306a4c-1632-4b4a-a7a4-894ba01c65df tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] HTTP exception thrown: Instance 4fae3aae-cb67-4c14-b358-59248d99238d could not be found. Apr 19 08:05:47 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-10306a4c-1632-4b4a-a7a4-894ba01c65df tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Request method failure captured: Apr 19 08:05:47 user devstack@n-api.service[61209]: request: GET /compute/v2.1/servers/4fae3aae-cb67-4c14-b358-59248d99238d HTTP/1.1 Apr 19 08:05:47 user devstack@n-api.service[61209]: Accept: application/json Apr 19 08:05:47 user devstack@n-api.service[61209]: Accept-Encoding: identity Apr 19 08:05:47 user devstack@n-api.service[61209]: Connection: close Apr 19 08:05:47 user devstack@n-api.service[61209]: Content-Length: 0 Apr 19 08:05:47 user devstack@n-api.service[61209]: Content-Type: application/json Apr 19 08:05:47 user devstack@n-api.service[61209]: Host: 10.0.0.210 Apr 19 08:05:47 user devstack@n-api.service[61209]: Openstack-System-Scope: None Apr 19 08:05:47 user devstack@n-api.service[61209]: User-Agent: python-urllib3/1.26.15 Apr 19 08:05:47 user devstack@n-api.service[61209]: X-Auth-Token: gAAAAABkP590q-ahQ5Y29nCjt-XVZex3NkwRRBb-e-hqThgBRftwXijZprl56weIlu4IFAZqImZw1OzRgUNn6GuqXr92gnS-u5cclHGrfBdQqLs4z0QFZX7pS8zztUPRvKyfHzPEsg7zarTo4ipl89UvYoGiXCiVu_NE26JgAlcta1LO8UrPKuY Apr 19 08:05:47 user devstack@n-api.service[61209]: X-Domain-Id: None Apr 19 08:05:47 user devstack@n-api.service[61209]: X-Domain-Name: None Apr 19 08:05:47 user devstack@n-api.service[61209]: X-Identity-Status: Confirmed Apr 19 08:05:47 user devstack@n-api.service[61209]: X-Is-Admin-Project: True Apr 19 08:05:47 user devstack@n-api.service[61209]: X-Project-Domain-Id: default Apr 19 08:05:47 user devstack@n-api.service[61209]: X-Project-Domain-Name: Default Apr 19 08:05:47 user devstack@n-api.service[61209]: X-Project-Id: 463fd5763cb24abeae209399cb8ff073 Apr 19 08:05:47 user devstack@n-api.service[61209]: X-Project-Name: tempest-VolumesAdminNegativeTest-1601310038 Apr 19 08:05:47 user devstack@n-api.service[61209]: X-Role: reader,member Apr 19 08:05:47 user devstack@n-api.service[61209]: X-Roles: reader,member Apr 19 08:05:47 user devstack@n-api.service[61209]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/463fd5763cb24abeae209399cb8ff073"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/463fd5763cb24abeae209399cb8ff073"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/463fd5763cb24abeae209399cb8ff073"}]}] Apr 19 08:05:47 user devstack@n-api.service[61209]: X-Tenant: tempest-VolumesAdminNegativeTest-1601310038 Apr 19 08:05:47 user devstack@n-api.service[61209]: X-Tenant-Id: 463fd5763cb24abeae209399cb8ff073 Apr 19 08:05:47 user devstack@n-api.service[61209]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1601310038 Apr 19 08:05:47 user devstack@n-api.service[61209]: X-User: tempest-VolumesAdminNegativeTest-1601310038-project-member Apr 19 08:05:47 user devstack@n-api.service[61209]: X-User-Domain-Id: default Apr 19 08:05:47 user devstack@n-api.service[61209]: X-User-Domain-Name: Default Apr 19 08:05:47 user devstack@n-api.service[61209]: X-User-Id: c38ef0fdb3c84ba9948b0806fd74f279 Apr 19 08:05:47 user devstack@n-api.service[61209]: X-User-Name: tempest-VolumesAdminNegativeTest-1601310038-project-member Apr 19 08:05:47 user devstack@n-api.service[61209]: method: > Apr 19 08:05:47 user devstack@n-api.service[61209]: exception: Instance 4fae3aae-cb67-4c14-b358-59248d99238d could not be found. Apr 19 08:05:47 user devstack@n-api.service[61209]: action_args: {'id': '4fae3aae-cb67-4c14-b358-59248d99238d'} Apr 19 08:05:47 user devstack@n-api.service[61209]: {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fae3aae-cb67-4c14-b358-59248d99238d could not be found. Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fae3aae-cb67-4c14-b358-59248d99238d could not be found. Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fae3aae-cb67-4c14-b358-59248d99238d could not be found. Apr 19 08:05:47 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:05:47 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-10306a4c-1632-4b4a-a7a4-894ba01c65df tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Returning 404 to user: Instance 4fae3aae-cb67-4c14-b358-59248d99238d could not be found. {{(pid=61209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:05:47 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-10306a4c-1632-4b4a-a7a4-894ba01c65df tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4fae3aae-cb67-4c14-b358-59248d99238d" status: 404 len: 111 microversion: 2.1 time: 0.146563 Apr 19 08:05:47 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 88/268] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:05:47 2023] GET /compute/v2.1/servers/4fae3aae-cb67-4c14-b358-59248d99238d => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:05:47 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-f74ee146-c521-46b5-bc33-2c9f6ac99f6d tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] Calling method '.version_select at 0x7f2c01051630>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:05:47 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=20 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:05:47 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=40 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:05:47 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-f74ee146-c521-46b5-bc33-2c9f6ac99f6d tempest-VolumesAdminNegativeTest-1601310038 tempest-VolumesAdminNegativeTest-1601310038-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1467729423" status: 202 len: 0 microversion: 2.1 time: 0.028252 Apr 19 08:05:47 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 91/269] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 08:05:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1467729423 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 08:06:01 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:06:01 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:06:01 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-b4967ccb-ff03-4521-a3c6-2407153b7c67 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1524196155", "imageRef": "b515545f-3b22-4d80-a102-6a318ab9717a", "flavorRef": "42", "networks": [{"uuid": "c200dc82-8f76-41a5-8f0d-25b3fdcf2132"}]}} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:06:01 user devstack@n-api.service[61208]: DEBUG nova.network.neutron [None req-b4967ccb-ff03-4521-a3c6-2407153b7c67 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] validate_networks() for [('c200dc82-8f76-41a5-8f0d-25b3fdcf2132', None, None, None, None, None)] {{(pid=61208) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 08:06:01 user devstack@n-api.service[61208]: DEBUG nova.virt.hardware [None req-b4967ccb-ff03-4521-a3c6-2407153b7c67 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Flavor limits 0:0:0 {{(pid=61208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 08:06:01 user devstack@n-api.service[61208]: DEBUG nova.virt.hardware [None req-b4967ccb-ff03-4521-a3c6-2407153b7c67 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Image limits 0:0:0 {{(pid=61208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 08:06:01 user devstack@n-api.service[61208]: DEBUG nova.virt.hardware [None req-b4967ccb-ff03-4521-a3c6-2407153b7c67 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Flavor pref 0:0:0 {{(pid=61208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 08:06:01 user devstack@n-api.service[61208]: DEBUG nova.virt.hardware [None req-b4967ccb-ff03-4521-a3c6-2407153b7c67 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Image pref 0:0:0 {{(pid=61208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 08:06:01 user devstack@n-api.service[61208]: DEBUG nova.virt.hardware [None req-b4967ccb-ff03-4521-a3c6-2407153b7c67 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61208) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 08:06:01 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b4967ccb-ff03-4521-a3c6-2407153b7c67 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:01 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b4967ccb-ff03-4521-a3c6-2407153b7c67 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:01 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b4967ccb-ff03-4521-a3c6-2407153b7c67 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:01 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b4967ccb-ff03-4521-a3c6-2407153b7c67 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:01 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b4967ccb-ff03-4521-a3c6-2407153b7c67 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:01 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b4967ccb-ff03-4521-a3c6-2407153b7c67 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:01 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-b4967ccb-ff03-4521-a3c6-2407153b7c67 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Getting quotas for project 7973fa0075de42e9a74627ae9cd98d9f. Resources: {'ram', 'cores', 'instances'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:06:01 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-b4967ccb-ff03-4521-a3c6-2407153b7c67 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Getting quotas for user 5530f99504de4426ba41cfa691c430c0 and project 7973fa0075de42e9a74627ae9cd98d9f. Resources: {'ram', 'cores', 'instances'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:06:01 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-b4967ccb-ff03-4521-a3c6-2407153b7c67 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Going to run 1 instances... {{(pid=61208) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 08:06:01 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-b4967ccb-ff03-4521-a3c6-2407153b7c67 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 3f04177b-d122-459b-871c-15c0964d793a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b515545f-3b22-4d80-a102-6a318ab9717a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61208) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 08:06:02 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-b4967ccb-ff03-4521-a3c6-2407153b7c67 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.704500 Apr 19 08:06:02 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 91/270] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 08:06:01 2023] POST /compute/v2.1/servers => generated 378 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 08:06:02 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-08749215-b04c-4b2b-9cfe-c70abd6da59c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:06:02 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-08749215-b04c-4b2b-9cfe-c70abd6da59c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 3f04177b-d122-459b-871c-15c0964d793a] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:06:02 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:06:02 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:06:02 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-08749215-b04c-4b2b-9cfe-c70abd6da59c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:06:02 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-08749215-b04c-4b2b-9cfe-c70abd6da59c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:06:02 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-08749215-b04c-4b2b-9cfe-c70abd6da59c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:06:02 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-08749215-b04c-4b2b-9cfe-c70abd6da59c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f04177b-d122-459b-871c-15c0964d793a" status: 200 len: 1395 microversion: 2.87 time: 0.083442 Apr 19 08:06:02 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 89/271] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:06:02 2023] GET /compute/v2.1/servers/3f04177b-d122-459b-871c-15c0964d793a => generated 1395 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 08:06:04 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:06:04 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-0552af9e-f72d-4a94-a3d7-fb9da88ff655 req-db0e0f12-14c3-4d21-92a0-c4b73b77a446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f04177b-d122-459b-871c-15c0964d793a", "tag": "eb1031c5-e333-4906-bb09-59f1a2ccf5a7"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:06:04 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-0552af9e-f72d-4a94-a3d7-fb9da88ff655 req-db0e0f12-14c3-4d21-92a0-c4b73b77a446 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:04 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-0552af9e-f72d-4a94-a3d7-fb9da88ff655 req-db0e0f12-14c3-4d21-92a0-c4b73b77a446 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:04 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-0552af9e-f72d-4a94-a3d7-fb9da88ff655 req-db0e0f12-14c3-4d21-92a0-c4b73b77a446 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:04 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-0552af9e-f72d-4a94-a3d7-fb9da88ff655 req-db0e0f12-14c3-4d21-92a0-c4b73b77a446 service nova] Creating event network-changed:eb1031c5-e333-4906-bb09-59f1a2ccf5a7 for instance 3f04177b-d122-459b-871c-15c0964d793a on user Apr 19 08:06:04 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-0552af9e-f72d-4a94-a3d7-fb9da88ff655 req-db0e0f12-14c3-4d21-92a0-c4b73b77a446 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038324 Apr 19 08:06:04 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 92/272] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:06:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:06:06 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-b4f6dd0e-3ee3-4fda-86de-11ba4e6a0838 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:06:06 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-b4f6dd0e-3ee3-4fda-86de-11ba4e6a0838 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] [instance: 02f0e5d6-1c4e-4549-8991-9dfcea958ac2] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:06:06 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b4f6dd0e-3ee3-4fda-86de-11ba4e6a0838 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:06 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b4f6dd0e-3ee3-4fda-86de-11ba4e6a0838 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:06 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b4f6dd0e-3ee3-4fda-86de-11ba4e6a0838 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:06 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b4f6dd0e-3ee3-4fda-86de-11ba4e6a0838 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:06 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b4f6dd0e-3ee3-4fda-86de-11ba4e6a0838 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:06 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b4f6dd0e-3ee3-4fda-86de-11ba4e6a0838 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:06 user devstack@n-api.service[61208]: INFO nova.api.openstack.wsgi [None req-b4f6dd0e-3ee3-4fda-86de-11ba4e6a0838 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] HTTP exception thrown: Instance 02f0e5d6-1c4e-4549-8991-9dfcea958ac2 could not be found. Apr 19 08:06:06 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-b4f6dd0e-3ee3-4fda-86de-11ba4e6a0838 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Request method failure captured: Apr 19 08:06:06 user devstack@n-api.service[61208]: request: GET /compute/v2.1/servers/02f0e5d6-1c4e-4549-8991-9dfcea958ac2 HTTP/1.1 Apr 19 08:06:06 user devstack@n-api.service[61208]: Accept: application/json Apr 19 08:06:06 user devstack@n-api.service[61208]: Accept-Encoding: identity Apr 19 08:06:06 user devstack@n-api.service[61208]: Connection: close Apr 19 08:06:06 user devstack@n-api.service[61208]: Content-Length: 0 Apr 19 08:06:06 user devstack@n-api.service[61208]: Content-Type: application/json Apr 19 08:06:06 user devstack@n-api.service[61208]: Host: 10.0.0.210 Apr 19 08:06:06 user devstack@n-api.service[61208]: Openstack-System-Scope: None Apr 19 08:06:06 user devstack@n-api.service[61208]: User-Agent: python-urllib3/1.26.15 Apr 19 08:06:06 user devstack@n-api.service[61208]: X-Auth-Token: gAAAAABkP5-Qk_GFYz0uu85MhVYHw_43UKBuy3GKXVwIo4gRbT4r8O3b_QqQw9jzY2gM8qhhV9wEa_42Occkzq8k903HxLHxXxoaDMMx_lLQVBdG_fOMJaudAWo3LXdbKID3kjkLlERHTFq9pPWy5ZZ29n_QUn7dMcQos6_y8HG4uqvAaZxMtVg Apr 19 08:06:06 user devstack@n-api.service[61208]: X-Domain-Id: None Apr 19 08:06:06 user devstack@n-api.service[61208]: X-Domain-Name: None Apr 19 08:06:06 user devstack@n-api.service[61208]: X-Identity-Status: Confirmed Apr 19 08:06:06 user devstack@n-api.service[61208]: X-Is-Admin-Project: True Apr 19 08:06:06 user devstack@n-api.service[61208]: X-Project-Domain-Id: default Apr 19 08:06:06 user devstack@n-api.service[61208]: X-Project-Domain-Name: Default Apr 19 08:06:06 user devstack@n-api.service[61208]: X-Project-Id: d5e8362c8d404717b2fa6e510f1de07a Apr 19 08:06:06 user devstack@n-api.service[61208]: X-Project-Name: tempest-TestMinimumBasicScenario-1741504408 Apr 19 08:06:06 user devstack@n-api.service[61208]: X-Role: reader,member Apr 19 08:06:06 user devstack@n-api.service[61208]: X-Roles: reader,member Apr 19 08:06:06 user devstack@n-api.service[61208]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5e8362c8d404717b2fa6e510f1de07a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5e8362c8d404717b2fa6e510f1de07a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5e8362c8d404717b2fa6e510f1de07a"}]}] Apr 19 08:06:06 user devstack@n-api.service[61208]: X-Tenant: tempest-TestMinimumBasicScenario-1741504408 Apr 19 08:06:06 user devstack@n-api.service[61208]: X-Tenant-Id: d5e8362c8d404717b2fa6e510f1de07a Apr 19 08:06:06 user devstack@n-api.service[61208]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1741504408 Apr 19 08:06:06 user devstack@n-api.service[61208]: X-User: tempest-TestMinimumBasicScenario-1741504408-project-member Apr 19 08:06:06 user devstack@n-api.service[61208]: X-User-Domain-Id: default Apr 19 08:06:06 user devstack@n-api.service[61208]: X-User-Domain-Name: Default Apr 19 08:06:06 user devstack@n-api.service[61208]: X-User-Id: 3d32cbfb3d854d56ad3961da3f406e77 Apr 19 08:06:06 user devstack@n-api.service[61208]: X-User-Name: tempest-TestMinimumBasicScenario-1741504408-project-member Apr 19 08:06:06 user devstack@n-api.service[61208]: method: > Apr 19 08:06:06 user devstack@n-api.service[61208]: exception: Instance 02f0e5d6-1c4e-4549-8991-9dfcea958ac2 could not be found. Apr 19 08:06:06 user devstack@n-api.service[61208]: action_args: {'id': '02f0e5d6-1c4e-4549-8991-9dfcea958ac2'} Apr 19 08:06:06 user devstack@n-api.service[61208]: {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02f0e5d6-1c4e-4549-8991-9dfcea958ac2 could not be found. Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02f0e5d6-1c4e-4549-8991-9dfcea958ac2 could not be found. Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02f0e5d6-1c4e-4549-8991-9dfcea958ac2 could not be found. Apr 19 08:06:06 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:06:06 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-b4f6dd0e-3ee3-4fda-86de-11ba4e6a0838 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Returning 404 to user: Instance 02f0e5d6-1c4e-4549-8991-9dfcea958ac2 could not be found. {{(pid=61208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:06:06 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-b4f6dd0e-3ee3-4fda-86de-11ba4e6a0838 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02f0e5d6-1c4e-4549-8991-9dfcea958ac2" status: 404 len: 111 microversion: 2.1 time: 0.159246 Apr 19 08:06:06 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 92/273] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:06:06 2023] GET /compute/v2.1/servers/02f0e5d6-1c4e-4549-8991-9dfcea958ac2 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:06:06 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-97fa2359-e132-4479-96ab-a1e758d4c168 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] Calling method '.version_select at 0x7f2c012f67a0>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:06:06 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-97fa2359-e132-4479-96ab-a1e758d4c168 tempest-TestMinimumBasicScenario-1741504408 tempest-TestMinimumBasicScenario-1741504408-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2114188020" status: 202 len: 0 microversion: 2.1 time: 0.021892 Apr 19 08:06:06 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 90/274] 10.0.0.210 () {62 vars in 1349 bytes} [Wed Apr 19 08:06:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2114188020 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 08:06:06 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-14eeef6f-4b18-4476-9bfc-18d9f695c178 req-42b0503a-7e31-47f4-9646-b15245ebb34a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f04177b-d122-459b-871c-15c0964d793a", "name": "network-vif-plugged", "status": "completed", "tag": "eb1031c5-e333-4906-bb09-59f1a2ccf5a7"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:06:06 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-14eeef6f-4b18-4476-9bfc-18d9f695c178 req-42b0503a-7e31-47f4-9646-b15245ebb34a service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:06 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-14eeef6f-4b18-4476-9bfc-18d9f695c178 req-42b0503a-7e31-47f4-9646-b15245ebb34a service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:06 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-14eeef6f-4b18-4476-9bfc-18d9f695c178 req-42b0503a-7e31-47f4-9646-b15245ebb34a service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:06 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-14eeef6f-4b18-4476-9bfc-18d9f695c178 req-42b0503a-7e31-47f4-9646-b15245ebb34a service nova] Creating event network-vif-plugged:eb1031c5-e333-4906-bb09-59f1a2ccf5a7 for instance 3f04177b-d122-459b-871c-15c0964d793a on user Apr 19 08:06:06 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-14eeef6f-4b18-4476-9bfc-18d9f695c178 req-42b0503a-7e31-47f4-9646-b15245ebb34a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038664 Apr 19 08:06:06 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 93/275] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:06:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:06:08 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-78c28f1c-a8fc-428b-b3c9-e5533d90cab5 req-6c2bcdf5-1d25-4c22-b55c-c5a894cfb263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f04177b-d122-459b-871c-15c0964d793a", "name": "network-vif-plugged", "status": "completed", "tag": "eb1031c5-e333-4906-bb09-59f1a2ccf5a7"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:06:08 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-78c28f1c-a8fc-428b-b3c9-e5533d90cab5 req-6c2bcdf5-1d25-4c22-b55c-c5a894cfb263 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:08 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-78c28f1c-a8fc-428b-b3c9-e5533d90cab5 req-6c2bcdf5-1d25-4c22-b55c-c5a894cfb263 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:08 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-78c28f1c-a8fc-428b-b3c9-e5533d90cab5 req-6c2bcdf5-1d25-4c22-b55c-c5a894cfb263 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:08 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-78c28f1c-a8fc-428b-b3c9-e5533d90cab5 req-6c2bcdf5-1d25-4c22-b55c-c5a894cfb263 service nova] Creating event network-vif-plugged:eb1031c5-e333-4906-bb09-59f1a2ccf5a7 for instance 3f04177b-d122-459b-871c-15c0964d793a on user Apr 19 08:06:08 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-78c28f1c-a8fc-428b-b3c9-e5533d90cab5 req-6c2bcdf5-1d25-4c22-b55c-c5a894cfb263 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038286 Apr 19 08:06:08 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 93/276] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:06:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:06:15 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:06:15 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-fb1ce05c-462c-418f-bd0b-3367d2ef38dd tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:06:15 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-fb1ce05c-462c-418f-bd0b-3367d2ef38dd tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] [instance: 2aa7cbc5-8b78-4631-a906-af3b4a63570a] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:06:15 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-fb1ce05c-462c-418f-bd0b-3367d2ef38dd tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:15 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-fb1ce05c-462c-418f-bd0b-3367d2ef38dd tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:15 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-fb1ce05c-462c-418f-bd0b-3367d2ef38dd tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:15 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-fb1ce05c-462c-418f-bd0b-3367d2ef38dd tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:15 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-fb1ce05c-462c-418f-bd0b-3367d2ef38dd tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:15 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-fb1ce05c-462c-418f-bd0b-3367d2ef38dd tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:15 user devstack@n-api.service[61209]: INFO nova.api.openstack.wsgi [None req-fb1ce05c-462c-418f-bd0b-3367d2ef38dd tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] HTTP exception thrown: Instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a could not be found. Apr 19 08:06:15 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-fb1ce05c-462c-418f-bd0b-3367d2ef38dd tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Request method failure captured: Apr 19 08:06:15 user devstack@n-api.service[61209]: request: GET /compute/v2.1/servers/2aa7cbc5-8b78-4631-a906-af3b4a63570a HTTP/1.1 Apr 19 08:06:15 user devstack@n-api.service[61209]: Accept: application/json Apr 19 08:06:15 user devstack@n-api.service[61209]: Accept-Encoding: identity Apr 19 08:06:15 user devstack@n-api.service[61209]: Connection: close Apr 19 08:06:15 user devstack@n-api.service[61209]: Content-Length: 0 Apr 19 08:06:15 user devstack@n-api.service[61209]: Content-Type: application/json Apr 19 08:06:15 user devstack@n-api.service[61209]: Host: 10.0.0.210 Apr 19 08:06:15 user devstack@n-api.service[61209]: Openstack-System-Scope: None Apr 19 08:06:15 user devstack@n-api.service[61209]: User-Agent: python-urllib3/1.26.15 Apr 19 08:06:15 user devstack@n-api.service[61209]: X-Auth-Token: gAAAAABkP5-oBRyQ4BeGi1AfbuX6Mloui33X0j1PxzbJ9i9bpcOAKFC-5ZEqiUTdlSV10jcIcUhYWWEV1suV_WhBEJEsBi4w928lQW3Bmlkl0BqHtK3dowcF7w_bL3qorWgr_I08Quls8HQKXBKGo3ryaJWi5NT1726epHv00d3iAyKQXphgHCE Apr 19 08:06:15 user devstack@n-api.service[61209]: X-Domain-Id: None Apr 19 08:06:15 user devstack@n-api.service[61209]: X-Domain-Name: None Apr 19 08:06:15 user devstack@n-api.service[61209]: X-Identity-Status: Confirmed Apr 19 08:06:15 user devstack@n-api.service[61209]: X-Is-Admin-Project: True Apr 19 08:06:15 user devstack@n-api.service[61209]: X-Project-Domain-Id: default Apr 19 08:06:15 user devstack@n-api.service[61209]: X-Project-Domain-Name: Default Apr 19 08:06:15 user devstack@n-api.service[61209]: X-Project-Id: 8d73100ea55541d08952a24ef6931a0a Apr 19 08:06:15 user devstack@n-api.service[61209]: X-Project-Name: tempest-AttachVolumeTestJSON-718709395 Apr 19 08:06:15 user devstack@n-api.service[61209]: X-Role: reader,member Apr 19 08:06:15 user devstack@n-api.service[61209]: X-Roles: reader,member Apr 19 08:06:15 user devstack@n-api.service[61209]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d73100ea55541d08952a24ef6931a0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d73100ea55541d08952a24ef6931a0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d73100ea55541d08952a24ef6931a0a"}]}] Apr 19 08:06:15 user devstack@n-api.service[61209]: X-Tenant: tempest-AttachVolumeTestJSON-718709395 Apr 19 08:06:15 user devstack@n-api.service[61209]: X-Tenant-Id: 8d73100ea55541d08952a24ef6931a0a Apr 19 08:06:15 user devstack@n-api.service[61209]: X-Tenant-Name: tempest-AttachVolumeTestJSON-718709395 Apr 19 08:06:15 user devstack@n-api.service[61209]: X-User: tempest-AttachVolumeTestJSON-718709395-project-member Apr 19 08:06:15 user devstack@n-api.service[61209]: X-User-Domain-Id: default Apr 19 08:06:15 user devstack@n-api.service[61209]: X-User-Domain-Name: Default Apr 19 08:06:15 user devstack@n-api.service[61209]: X-User-Id: 64f18935b0524876bf69f22cff03139a Apr 19 08:06:15 user devstack@n-api.service[61209]: X-User-Name: tempest-AttachVolumeTestJSON-718709395-project-member Apr 19 08:06:15 user devstack@n-api.service[61209]: method: > Apr 19 08:06:15 user devstack@n-api.service[61209]: exception: Instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a could not be found. Apr 19 08:06:15 user devstack@n-api.service[61209]: action_args: {'id': '2aa7cbc5-8b78-4631-a906-af3b4a63570a'} Apr 19 08:06:15 user devstack@n-api.service[61209]: {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a could not be found. Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a could not be found. Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a could not be found. Apr 19 08:06:15 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:06:15 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-fb1ce05c-462c-418f-bd0b-3367d2ef38dd tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Returning 404 to user: Instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a could not be found. {{(pid=61209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:06:15 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-fb1ce05c-462c-418f-bd0b-3367d2ef38dd tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aa7cbc5-8b78-4631-a906-af3b4a63570a" status: 404 len: 111 microversion: 2.1 time: 0.236890 Apr 19 08:06:15 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 91/277] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:06:15 2023] GET /compute/v2.1/servers/2aa7cbc5-8b78-4631-a906-af3b4a63570a => generated 111 bytes in 238 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:06:15 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-9935f306-b5ee-4164-977a-fa905f9b301c tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Calling method '.version_select at 0x7f2c010527a0>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:06:15 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-9935f306-b5ee-4164-977a-fa905f9b301c tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2037294831" status: 202 len: 0 microversion: 2.1 time: 0.025018 Apr 19 08:06:15 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 94/278] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 08:06:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2037294831 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 08:06:16 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:06:16 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=6 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:06:16 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-53c18b2e-1ef7-48ee-b66c-8960ac02db79 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:06:16 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-53c18b2e-1ef7-48ee-b66c-8960ac02db79 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] [instance: f3504e30-9be0-40b5-a53c-859dadad53a1] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:06:16 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-53c18b2e-1ef7-48ee-b66c-8960ac02db79 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:16 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-53c18b2e-1ef7-48ee-b66c-8960ac02db79 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:16 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-53c18b2e-1ef7-48ee-b66c-8960ac02db79 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:16 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-53c18b2e-1ef7-48ee-b66c-8960ac02db79 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:16 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-53c18b2e-1ef7-48ee-b66c-8960ac02db79 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:16 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-53c18b2e-1ef7-48ee-b66c-8960ac02db79 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:16 user devstack@n-api.service[61208]: INFO nova.api.openstack.wsgi [None req-53c18b2e-1ef7-48ee-b66c-8960ac02db79 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] HTTP exception thrown: Instance f3504e30-9be0-40b5-a53c-859dadad53a1 could not be found. Apr 19 08:06:16 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-53c18b2e-1ef7-48ee-b66c-8960ac02db79 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Request method failure captured: Apr 19 08:06:16 user devstack@n-api.service[61208]: request: GET /compute/v2.1/servers/f3504e30-9be0-40b5-a53c-859dadad53a1 HTTP/1.1 Apr 19 08:06:16 user devstack@n-api.service[61208]: Accept: application/json Apr 19 08:06:16 user devstack@n-api.service[61208]: Accept-Encoding: identity Apr 19 08:06:16 user devstack@n-api.service[61208]: Connection: close Apr 19 08:06:16 user devstack@n-api.service[61208]: Content-Length: 0 Apr 19 08:06:16 user devstack@n-api.service[61208]: Content-Type: application/json Apr 19 08:06:16 user devstack@n-api.service[61208]: Host: 10.0.0.210 Apr 19 08:06:16 user devstack@n-api.service[61208]: Openstack-System-Scope: None Apr 19 08:06:16 user devstack@n-api.service[61208]: User-Agent: python-urllib3/1.26.15 Apr 19 08:06:16 user devstack@n-api.service[61208]: X-Auth-Token: gAAAAABkP59xNTwhlAAAA2JujT-wo_l2ufuMV8sTTMDaFIGwuGfsQbRJUCZbxTUji78sJUAoKHBI9AYyV5Ld-YVfxFM12oBsiXjUQFlV1dJufG6HK5Q9kwR6qTq9ERFwo-wsxZEkpFB3mL9F4bjFKrUbr6tCW8rQ4EIA5NnGDxvwWSN4nYEKJUk Apr 19 08:06:16 user devstack@n-api.service[61208]: X-Domain-Id: None Apr 19 08:06:16 user devstack@n-api.service[61208]: X-Domain-Name: None Apr 19 08:06:16 user devstack@n-api.service[61208]: X-Identity-Status: Confirmed Apr 19 08:06:16 user devstack@n-api.service[61208]: X-Is-Admin-Project: True Apr 19 08:06:16 user devstack@n-api.service[61208]: X-Project-Domain-Id: default Apr 19 08:06:16 user devstack@n-api.service[61208]: X-Project-Domain-Name: Default Apr 19 08:06:16 user devstack@n-api.service[61208]: X-Project-Id: 173f7e00d8f748debe5a126203220f7f Apr 19 08:06:16 user devstack@n-api.service[61208]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-175442756 Apr 19 08:06:16 user devstack@n-api.service[61208]: X-Role: reader,member Apr 19 08:06:16 user devstack@n-api.service[61208]: X-Roles: reader,member Apr 19 08:06:16 user devstack@n-api.service[61208]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/173f7e00d8f748debe5a126203220f7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/173f7e00d8f748debe5a126203220f7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/173f7e00d8f748debe5a126203220f7f"}]}] Apr 19 08:06:16 user devstack@n-api.service[61208]: X-Tenant: tempest-ServerRescueNegativeTestJSON-175442756 Apr 19 08:06:16 user devstack@n-api.service[61208]: X-Tenant-Id: 173f7e00d8f748debe5a126203220f7f Apr 19 08:06:16 user devstack@n-api.service[61208]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-175442756 Apr 19 08:06:16 user devstack@n-api.service[61208]: X-User: tempest-ServerRescueNegativeTestJSON-175442756-project-member Apr 19 08:06:16 user devstack@n-api.service[61208]: X-User-Domain-Id: default Apr 19 08:06:16 user devstack@n-api.service[61208]: X-User-Domain-Name: Default Apr 19 08:06:16 user devstack@n-api.service[61208]: X-User-Id: e9796d2c200d4419b0fe67d541efc8f4 Apr 19 08:06:16 user devstack@n-api.service[61208]: X-User-Name: tempest-ServerRescueNegativeTestJSON-175442756-project-member Apr 19 08:06:16 user devstack@n-api.service[61208]: method: > Apr 19 08:06:16 user devstack@n-api.service[61208]: exception: Instance f3504e30-9be0-40b5-a53c-859dadad53a1 could not be found. Apr 19 08:06:16 user devstack@n-api.service[61208]: action_args: {'id': 'f3504e30-9be0-40b5-a53c-859dadad53a1'} Apr 19 08:06:16 user devstack@n-api.service[61208]: {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3504e30-9be0-40b5-a53c-859dadad53a1 could not be found. Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3504e30-9be0-40b5-a53c-859dadad53a1 could not be found. Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3504e30-9be0-40b5-a53c-859dadad53a1 could not be found. Apr 19 08:06:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:06:16 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-53c18b2e-1ef7-48ee-b66c-8960ac02db79 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] Returning 404 to user: Instance f3504e30-9be0-40b5-a53c-859dadad53a1 could not be found. {{(pid=61208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:06:16 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-53c18b2e-1ef7-48ee-b66c-8960ac02db79 tempest-ServerRescueNegativeTestJSON-175442756 tempest-ServerRescueNegativeTestJSON-175442756-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3504e30-9be0-40b5-a53c-859dadad53a1" status: 404 len: 111 microversion: 2.1 time: 0.034975 Apr 19 08:06:16 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 94/279] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:06:16 2023] GET /compute/v2.1/servers/f3504e30-9be0-40b5-a53c-859dadad53a1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:06:16 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-5cb3dd24-80ce-4902-8206-3711a131ee4f tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:06:16 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-5cb3dd24-80ce-4902-8206-3711a131ee4f tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] [instance: 2aa7cbc5-8b78-4631-a906-af3b4a63570a] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:06:16 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5cb3dd24-80ce-4902-8206-3711a131ee4f tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:16 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5cb3dd24-80ce-4902-8206-3711a131ee4f tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:16 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5cb3dd24-80ce-4902-8206-3711a131ee4f tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:16 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5cb3dd24-80ce-4902-8206-3711a131ee4f tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:16 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5cb3dd24-80ce-4902-8206-3711a131ee4f tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:16 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5cb3dd24-80ce-4902-8206-3711a131ee4f tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:17 user devstack@n-api.service[61209]: INFO nova.api.openstack.wsgi [None req-5cb3dd24-80ce-4902-8206-3711a131ee4f tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] HTTP exception thrown: Instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a could not be found. Apr 19 08:06:17 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-5cb3dd24-80ce-4902-8206-3711a131ee4f tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Request method failure captured: Apr 19 08:06:17 user devstack@n-api.service[61209]: request: DELETE /compute/v2.1/servers/2aa7cbc5-8b78-4631-a906-af3b4a63570a HTTP/1.1 Apr 19 08:06:17 user devstack@n-api.service[61209]: Accept: application/json Apr 19 08:06:17 user devstack@n-api.service[61209]: Accept-Encoding: identity Apr 19 08:06:17 user devstack@n-api.service[61209]: Connection: close Apr 19 08:06:17 user devstack@n-api.service[61209]: Content-Length: 0 Apr 19 08:06:17 user devstack@n-api.service[61209]: Content-Type: application/json Apr 19 08:06:17 user devstack@n-api.service[61209]: Host: 10.0.0.210 Apr 19 08:06:17 user devstack@n-api.service[61209]: Openstack-System-Scope: None Apr 19 08:06:17 user devstack@n-api.service[61209]: User-Agent: python-urllib3/1.26.15 Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Auth-Token: gAAAAABkP5-oBRyQ4BeGi1AfbuX6Mloui33X0j1PxzbJ9i9bpcOAKFC-5ZEqiUTdlSV10jcIcUhYWWEV1suV_WhBEJEsBi4w928lQW3Bmlkl0BqHtK3dowcF7w_bL3qorWgr_I08Quls8HQKXBKGo3ryaJWi5NT1726epHv00d3iAyKQXphgHCE Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Domain-Id: None Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Domain-Name: None Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Identity-Status: Confirmed Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Is-Admin-Project: True Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Project-Domain-Id: default Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Project-Domain-Name: Default Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Project-Id: 8d73100ea55541d08952a24ef6931a0a Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Project-Name: tempest-AttachVolumeTestJSON-718709395 Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Role: reader,member Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Roles: reader,member Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d73100ea55541d08952a24ef6931a0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d73100ea55541d08952a24ef6931a0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d73100ea55541d08952a24ef6931a0a"}]}] Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Tenant: tempest-AttachVolumeTestJSON-718709395 Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Tenant-Id: 8d73100ea55541d08952a24ef6931a0a Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Tenant-Name: tempest-AttachVolumeTestJSON-718709395 Apr 19 08:06:17 user devstack@n-api.service[61209]: X-User: tempest-AttachVolumeTestJSON-718709395-project-member Apr 19 08:06:17 user devstack@n-api.service[61209]: X-User-Domain-Id: default Apr 19 08:06:17 user devstack@n-api.service[61209]: X-User-Domain-Name: Default Apr 19 08:06:17 user devstack@n-api.service[61209]: X-User-Id: 64f18935b0524876bf69f22cff03139a Apr 19 08:06:17 user devstack@n-api.service[61209]: X-User-Name: tempest-AttachVolumeTestJSON-718709395-project-member Apr 19 08:06:17 user devstack@n-api.service[61209]: method: > Apr 19 08:06:17 user devstack@n-api.service[61209]: exception: Instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a could not be found. Apr 19 08:06:17 user devstack@n-api.service[61209]: action_args: {'id': '2aa7cbc5-8b78-4631-a906-af3b4a63570a'} Apr 19 08:06:17 user devstack@n-api.service[61209]: {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a could not be found. Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a could not be found. Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a could not be found. Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:06:17 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-5cb3dd24-80ce-4902-8206-3711a131ee4f tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Returning 404 to user: Instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a could not be found. {{(pid=61209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:06:17 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-5cb3dd24-80ce-4902-8206-3711a131ee4f tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2aa7cbc5-8b78-4631-a906-af3b4a63570a" status: 404 len: 111 microversion: 2.1 time: 0.046104 Apr 19 08:06:17 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 92/280] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:06:16 2023] DELETE /compute/v2.1/servers/2aa7cbc5-8b78-4631-a906-af3b4a63570a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:06:17 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=4 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:06:17 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-b10bca20-f872-4f9a-9547-a93c40423f5d tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:06:17 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-b10bca20-f872-4f9a-9547-a93c40423f5d tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] [instance: 2aa7cbc5-8b78-4631-a906-af3b4a63570a] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:06:17 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-b10bca20-f872-4f9a-9547-a93c40423f5d tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:17 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-b10bca20-f872-4f9a-9547-a93c40423f5d tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:17 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-b10bca20-f872-4f9a-9547-a93c40423f5d tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:17 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-b10bca20-f872-4f9a-9547-a93c40423f5d tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:17 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-b10bca20-f872-4f9a-9547-a93c40423f5d tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:17 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-b10bca20-f872-4f9a-9547-a93c40423f5d tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:17 user devstack@n-api.service[61210]: INFO nova.api.openstack.wsgi [None req-b10bca20-f872-4f9a-9547-a93c40423f5d tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] HTTP exception thrown: Instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a could not be found. Apr 19 08:06:17 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-b10bca20-f872-4f9a-9547-a93c40423f5d tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Request method failure captured: Apr 19 08:06:17 user devstack@n-api.service[61210]: request: GET /compute/v2.1/servers/2aa7cbc5-8b78-4631-a906-af3b4a63570a HTTP/1.1 Apr 19 08:06:17 user devstack@n-api.service[61210]: Accept: application/json Apr 19 08:06:17 user devstack@n-api.service[61210]: Accept-Encoding: identity Apr 19 08:06:17 user devstack@n-api.service[61210]: Connection: close Apr 19 08:06:17 user devstack@n-api.service[61210]: Content-Length: 0 Apr 19 08:06:17 user devstack@n-api.service[61210]: Content-Type: application/json Apr 19 08:06:17 user devstack@n-api.service[61210]: Host: 10.0.0.210 Apr 19 08:06:17 user devstack@n-api.service[61210]: Openstack-System-Scope: None Apr 19 08:06:17 user devstack@n-api.service[61210]: User-Agent: python-urllib3/1.26.15 Apr 19 08:06:17 user devstack@n-api.service[61210]: X-Auth-Token: gAAAAABkP5-oBRyQ4BeGi1AfbuX6Mloui33X0j1PxzbJ9i9bpcOAKFC-5ZEqiUTdlSV10jcIcUhYWWEV1suV_WhBEJEsBi4w928lQW3Bmlkl0BqHtK3dowcF7w_bL3qorWgr_I08Quls8HQKXBKGo3ryaJWi5NT1726epHv00d3iAyKQXphgHCE Apr 19 08:06:17 user devstack@n-api.service[61210]: X-Domain-Id: None Apr 19 08:06:17 user devstack@n-api.service[61210]: X-Domain-Name: None Apr 19 08:06:17 user devstack@n-api.service[61210]: X-Identity-Status: Confirmed Apr 19 08:06:17 user devstack@n-api.service[61210]: X-Is-Admin-Project: True Apr 19 08:06:17 user devstack@n-api.service[61210]: X-Project-Domain-Id: default Apr 19 08:06:17 user devstack@n-api.service[61210]: X-Project-Domain-Name: Default Apr 19 08:06:17 user devstack@n-api.service[61210]: X-Project-Id: 8d73100ea55541d08952a24ef6931a0a Apr 19 08:06:17 user devstack@n-api.service[61210]: X-Project-Name: tempest-AttachVolumeTestJSON-718709395 Apr 19 08:06:17 user devstack@n-api.service[61210]: X-Role: reader,member Apr 19 08:06:17 user devstack@n-api.service[61210]: X-Roles: reader,member Apr 19 08:06:17 user devstack@n-api.service[61210]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d73100ea55541d08952a24ef6931a0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d73100ea55541d08952a24ef6931a0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d73100ea55541d08952a24ef6931a0a"}]}] Apr 19 08:06:17 user devstack@n-api.service[61210]: X-Tenant: tempest-AttachVolumeTestJSON-718709395 Apr 19 08:06:17 user devstack@n-api.service[61210]: X-Tenant-Id: 8d73100ea55541d08952a24ef6931a0a Apr 19 08:06:17 user devstack@n-api.service[61210]: X-Tenant-Name: tempest-AttachVolumeTestJSON-718709395 Apr 19 08:06:17 user devstack@n-api.service[61210]: X-User: tempest-AttachVolumeTestJSON-718709395-project-member Apr 19 08:06:17 user devstack@n-api.service[61210]: X-User-Domain-Id: default Apr 19 08:06:17 user devstack@n-api.service[61210]: X-User-Domain-Name: Default Apr 19 08:06:17 user devstack@n-api.service[61210]: X-User-Id: 64f18935b0524876bf69f22cff03139a Apr 19 08:06:17 user devstack@n-api.service[61210]: X-User-Name: tempest-AttachVolumeTestJSON-718709395-project-member Apr 19 08:06:17 user devstack@n-api.service[61210]: method: > Apr 19 08:06:17 user devstack@n-api.service[61210]: exception: Instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a could not be found. Apr 19 08:06:17 user devstack@n-api.service[61210]: action_args: {'id': '2aa7cbc5-8b78-4631-a906-af3b4a63570a'} Apr 19 08:06:17 user devstack@n-api.service[61210]: {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a could not be found. Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a could not be found. Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a could not be found. Apr 19 08:06:17 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:06:17 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-b10bca20-f872-4f9a-9547-a93c40423f5d tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Returning 404 to user: Instance 2aa7cbc5-8b78-4631-a906-af3b4a63570a could not be found. {{(pid=61210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:06:17 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-b10bca20-f872-4f9a-9547-a93c40423f5d tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2aa7cbc5-8b78-4631-a906-af3b4a63570a" status: 404 len: 111 microversion: 2.1 time: 0.035015 Apr 19 08:06:17 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 95/281] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:06:17 2023] GET /compute/v2.1/servers/2aa7cbc5-8b78-4631-a906-af3b4a63570a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:06:17 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-44859823-bf02-4443-813f-4914b7709419 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:06:17 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-44859823-bf02-4443-813f-4914b7709419 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] [instance: 5eb02260-a7ea-4b05-8d8d-72950cfce57b] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:06:17 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-44859823-bf02-4443-813f-4914b7709419 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:17 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-44859823-bf02-4443-813f-4914b7709419 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:17 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-44859823-bf02-4443-813f-4914b7709419 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:17 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-44859823-bf02-4443-813f-4914b7709419 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:17 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-44859823-bf02-4443-813f-4914b7709419 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:17 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-44859823-bf02-4443-813f-4914b7709419 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:17 user devstack@n-api.service[61208]: INFO nova.api.openstack.wsgi [None req-44859823-bf02-4443-813f-4914b7709419 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] HTTP exception thrown: Instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b could not be found. Apr 19 08:06:17 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-44859823-bf02-4443-813f-4914b7709419 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Request method failure captured: Apr 19 08:06:17 user devstack@n-api.service[61208]: request: DELETE /compute/v2.1/servers/5eb02260-a7ea-4b05-8d8d-72950cfce57b HTTP/1.1 Apr 19 08:06:17 user devstack@n-api.service[61208]: Accept: application/json Apr 19 08:06:17 user devstack@n-api.service[61208]: Accept-Encoding: identity Apr 19 08:06:17 user devstack@n-api.service[61208]: Connection: close Apr 19 08:06:17 user devstack@n-api.service[61208]: Content-Length: 0 Apr 19 08:06:17 user devstack@n-api.service[61208]: Content-Type: application/json Apr 19 08:06:17 user devstack@n-api.service[61208]: Host: 10.0.0.210 Apr 19 08:06:17 user devstack@n-api.service[61208]: Openstack-System-Scope: None Apr 19 08:06:17 user devstack@n-api.service[61208]: User-Agent: python-urllib3/1.26.15 Apr 19 08:06:17 user devstack@n-api.service[61208]: X-Auth-Token: gAAAAABkP5-oBRyQ4BeGi1AfbuX6Mloui33X0j1PxzbJ9i9bpcOAKFC-5ZEqiUTdlSV10jcIcUhYWWEV1suV_WhBEJEsBi4w928lQW3Bmlkl0BqHtK3dowcF7w_bL3qorWgr_I08Quls8HQKXBKGo3ryaJWi5NT1726epHv00d3iAyKQXphgHCE Apr 19 08:06:17 user devstack@n-api.service[61208]: X-Domain-Id: None Apr 19 08:06:17 user devstack@n-api.service[61208]: X-Domain-Name: None Apr 19 08:06:17 user devstack@n-api.service[61208]: X-Identity-Status: Confirmed Apr 19 08:06:17 user devstack@n-api.service[61208]: X-Is-Admin-Project: True Apr 19 08:06:17 user devstack@n-api.service[61208]: X-Project-Domain-Id: default Apr 19 08:06:17 user devstack@n-api.service[61208]: X-Project-Domain-Name: Default Apr 19 08:06:17 user devstack@n-api.service[61208]: X-Project-Id: 8d73100ea55541d08952a24ef6931a0a Apr 19 08:06:17 user devstack@n-api.service[61208]: X-Project-Name: tempest-AttachVolumeTestJSON-718709395 Apr 19 08:06:17 user devstack@n-api.service[61208]: X-Role: reader,member Apr 19 08:06:17 user devstack@n-api.service[61208]: X-Roles: reader,member Apr 19 08:06:17 user devstack@n-api.service[61208]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d73100ea55541d08952a24ef6931a0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d73100ea55541d08952a24ef6931a0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d73100ea55541d08952a24ef6931a0a"}]}] Apr 19 08:06:17 user devstack@n-api.service[61208]: X-Tenant: tempest-AttachVolumeTestJSON-718709395 Apr 19 08:06:17 user devstack@n-api.service[61208]: X-Tenant-Id: 8d73100ea55541d08952a24ef6931a0a Apr 19 08:06:17 user devstack@n-api.service[61208]: X-Tenant-Name: tempest-AttachVolumeTestJSON-718709395 Apr 19 08:06:17 user devstack@n-api.service[61208]: X-User: tempest-AttachVolumeTestJSON-718709395-project-member Apr 19 08:06:17 user devstack@n-api.service[61208]: X-User-Domain-Id: default Apr 19 08:06:17 user devstack@n-api.service[61208]: X-User-Domain-Name: Default Apr 19 08:06:17 user devstack@n-api.service[61208]: X-User-Id: 64f18935b0524876bf69f22cff03139a Apr 19 08:06:17 user devstack@n-api.service[61208]: X-User-Name: tempest-AttachVolumeTestJSON-718709395-project-member Apr 19 08:06:17 user devstack@n-api.service[61208]: method: > Apr 19 08:06:17 user devstack@n-api.service[61208]: exception: Instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b could not be found. Apr 19 08:06:17 user devstack@n-api.service[61208]: action_args: {'id': '5eb02260-a7ea-4b05-8d8d-72950cfce57b'} Apr 19 08:06:17 user devstack@n-api.service[61208]: {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b could not be found. Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b could not be found. Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b could not be found. Apr 19 08:06:17 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:06:17 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-44859823-bf02-4443-813f-4914b7709419 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Returning 404 to user: Instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b could not be found. {{(pid=61208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:06:17 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-44859823-bf02-4443-813f-4914b7709419 tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5eb02260-a7ea-4b05-8d8d-72950cfce57b" status: 404 len: 111 microversion: 2.1 time: 0.035815 Apr 19 08:06:17 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 95/282] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:06:17 2023] DELETE /compute/v2.1/servers/5eb02260-a7ea-4b05-8d8d-72950cfce57b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:06:17 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-30ac6311-fc77-45b1-b006-125b2a4b1afc tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:06:17 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-30ac6311-fc77-45b1-b006-125b2a4b1afc tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] [instance: 5eb02260-a7ea-4b05-8d8d-72950cfce57b] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:06:17 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-30ac6311-fc77-45b1-b006-125b2a4b1afc tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:17 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-30ac6311-fc77-45b1-b006-125b2a4b1afc tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:17 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-30ac6311-fc77-45b1-b006-125b2a4b1afc tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:17 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-30ac6311-fc77-45b1-b006-125b2a4b1afc tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:17 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-30ac6311-fc77-45b1-b006-125b2a4b1afc tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:17 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-30ac6311-fc77-45b1-b006-125b2a4b1afc tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:17 user devstack@n-api.service[61209]: INFO nova.api.openstack.wsgi [None req-30ac6311-fc77-45b1-b006-125b2a4b1afc tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] HTTP exception thrown: Instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b could not be found. Apr 19 08:06:17 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-30ac6311-fc77-45b1-b006-125b2a4b1afc tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Request method failure captured: Apr 19 08:06:17 user devstack@n-api.service[61209]: request: GET /compute/v2.1/servers/5eb02260-a7ea-4b05-8d8d-72950cfce57b HTTP/1.1 Apr 19 08:06:17 user devstack@n-api.service[61209]: Accept: application/json Apr 19 08:06:17 user devstack@n-api.service[61209]: Accept-Encoding: identity Apr 19 08:06:17 user devstack@n-api.service[61209]: Connection: close Apr 19 08:06:17 user devstack@n-api.service[61209]: Content-Length: 0 Apr 19 08:06:17 user devstack@n-api.service[61209]: Content-Type: application/json Apr 19 08:06:17 user devstack@n-api.service[61209]: Host: 10.0.0.210 Apr 19 08:06:17 user devstack@n-api.service[61209]: Openstack-System-Scope: None Apr 19 08:06:17 user devstack@n-api.service[61209]: User-Agent: python-urllib3/1.26.15 Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Auth-Token: gAAAAABkP5-oBRyQ4BeGi1AfbuX6Mloui33X0j1PxzbJ9i9bpcOAKFC-5ZEqiUTdlSV10jcIcUhYWWEV1suV_WhBEJEsBi4w928lQW3Bmlkl0BqHtK3dowcF7w_bL3qorWgr_I08Quls8HQKXBKGo3ryaJWi5NT1726epHv00d3iAyKQXphgHCE Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Domain-Id: None Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Domain-Name: None Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Identity-Status: Confirmed Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Is-Admin-Project: True Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Project-Domain-Id: default Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Project-Domain-Name: Default Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Project-Id: 8d73100ea55541d08952a24ef6931a0a Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Project-Name: tempest-AttachVolumeTestJSON-718709395 Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Role: reader,member Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Roles: reader,member Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d73100ea55541d08952a24ef6931a0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d73100ea55541d08952a24ef6931a0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d73100ea55541d08952a24ef6931a0a"}]}] Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Tenant: tempest-AttachVolumeTestJSON-718709395 Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Tenant-Id: 8d73100ea55541d08952a24ef6931a0a Apr 19 08:06:17 user devstack@n-api.service[61209]: X-Tenant-Name: tempest-AttachVolumeTestJSON-718709395 Apr 19 08:06:17 user devstack@n-api.service[61209]: X-User: tempest-AttachVolumeTestJSON-718709395-project-member Apr 19 08:06:17 user devstack@n-api.service[61209]: X-User-Domain-Id: default Apr 19 08:06:17 user devstack@n-api.service[61209]: X-User-Domain-Name: Default Apr 19 08:06:17 user devstack@n-api.service[61209]: X-User-Id: 64f18935b0524876bf69f22cff03139a Apr 19 08:06:17 user devstack@n-api.service[61209]: X-User-Name: tempest-AttachVolumeTestJSON-718709395-project-member Apr 19 08:06:17 user devstack@n-api.service[61209]: method: > Apr 19 08:06:17 user devstack@n-api.service[61209]: exception: Instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b could not be found. Apr 19 08:06:17 user devstack@n-api.service[61209]: action_args: {'id': '5eb02260-a7ea-4b05-8d8d-72950cfce57b'} Apr 19 08:06:17 user devstack@n-api.service[61209]: {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b could not be found. Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b could not be found. Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b could not be found. Apr 19 08:06:17 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:06:17 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-30ac6311-fc77-45b1-b006-125b2a4b1afc tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] Returning 404 to user: Instance 5eb02260-a7ea-4b05-8d8d-72950cfce57b could not be found. {{(pid=61209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:06:17 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-30ac6311-fc77-45b1-b006-125b2a4b1afc tempest-AttachVolumeTestJSON-718709395 tempest-AttachVolumeTestJSON-718709395-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5eb02260-a7ea-4b05-8d8d-72950cfce57b" status: 404 len: 111 microversion: 2.1 time: 0.029186 Apr 19 08:06:17 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 93/283] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:06:17 2023] GET /compute/v2.1/servers/5eb02260-a7ea-4b05-8d8d-72950cfce57b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 19 08:06:18 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-e44328b5-7402-48bf-b4b8-6b89702298a8 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:06:18 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-e44328b5-7402-48bf-b4b8-6b89702298a8 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] [instance: bb5de453-e849-4495-8e25-6d3b0e8c3569] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:06:18 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e44328b5-7402-48bf-b4b8-6b89702298a8 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:18 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e44328b5-7402-48bf-b4b8-6b89702298a8 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:18 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e44328b5-7402-48bf-b4b8-6b89702298a8 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:18 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e44328b5-7402-48bf-b4b8-6b89702298a8 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:18 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e44328b5-7402-48bf-b4b8-6b89702298a8 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:18 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e44328b5-7402-48bf-b4b8-6b89702298a8 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:18 user devstack@n-api.service[61210]: INFO nova.api.openstack.wsgi [None req-e44328b5-7402-48bf-b4b8-6b89702298a8 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] HTTP exception thrown: Instance bb5de453-e849-4495-8e25-6d3b0e8c3569 could not be found. Apr 19 08:06:18 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-e44328b5-7402-48bf-b4b8-6b89702298a8 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Request method failure captured: Apr 19 08:06:18 user devstack@n-api.service[61210]: request: GET /compute/v2.1/servers/bb5de453-e849-4495-8e25-6d3b0e8c3569 HTTP/1.1 Apr 19 08:06:18 user devstack@n-api.service[61210]: Accept: application/json Apr 19 08:06:18 user devstack@n-api.service[61210]: Accept-Encoding: identity Apr 19 08:06:18 user devstack@n-api.service[61210]: Connection: close Apr 19 08:06:18 user devstack@n-api.service[61210]: Content-Length: 0 Apr 19 08:06:18 user devstack@n-api.service[61210]: Content-Type: application/json Apr 19 08:06:18 user devstack@n-api.service[61210]: Host: 10.0.0.210 Apr 19 08:06:18 user devstack@n-api.service[61210]: Openstack-System-Scope: None Apr 19 08:06:18 user devstack@n-api.service[61210]: User-Agent: python-urllib3/1.26.15 Apr 19 08:06:18 user devstack@n-api.service[61210]: X-Auth-Token: gAAAAABkP6BMpyVZmm9UY7DFJ3fdsP5wnUPaBNuLS4Wdx_8Qh1Jfzbj21_SUBMRk2LR_CMkYCzLtC_YmzH9laI773h-AXjcktaNumGGYKKfAc1potVbbQRjYKFRd72Ed4KXzLto3rcrtdUvN95Pq2qUGeLx8SjqejJQVBnjPW4MakvrZqPv4Eqc Apr 19 08:06:18 user devstack@n-api.service[61210]: X-Domain-Id: None Apr 19 08:06:18 user devstack@n-api.service[61210]: X-Domain-Name: None Apr 19 08:06:18 user devstack@n-api.service[61210]: X-Identity-Status: Confirmed Apr 19 08:06:18 user devstack@n-api.service[61210]: X-Is-Admin-Project: True Apr 19 08:06:18 user devstack@n-api.service[61210]: X-Project-Domain-Id: default Apr 19 08:06:18 user devstack@n-api.service[61210]: X-Project-Domain-Name: Default Apr 19 08:06:18 user devstack@n-api.service[61210]: X-Project-Id: e5e7f06d44ee43138f373093d40014fa Apr 19 08:06:18 user devstack@n-api.service[61210]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1194625945 Apr 19 08:06:18 user devstack@n-api.service[61210]: X-Role: reader,member Apr 19 08:06:18 user devstack@n-api.service[61210]: X-Roles: reader,member Apr 19 08:06:18 user devstack@n-api.service[61210]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e5e7f06d44ee43138f373093d40014fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e5e7f06d44ee43138f373093d40014fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e5e7f06d44ee43138f373093d40014fa"}]}] Apr 19 08:06:18 user devstack@n-api.service[61210]: X-Tenant: tempest-SnapshotDataIntegrityTests-1194625945 Apr 19 08:06:18 user devstack@n-api.service[61210]: X-Tenant-Id: e5e7f06d44ee43138f373093d40014fa Apr 19 08:06:18 user devstack@n-api.service[61210]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1194625945 Apr 19 08:06:18 user devstack@n-api.service[61210]: X-User: tempest-SnapshotDataIntegrityTests-1194625945-project-member Apr 19 08:06:18 user devstack@n-api.service[61210]: X-User-Domain-Id: default Apr 19 08:06:18 user devstack@n-api.service[61210]: X-User-Domain-Name: Default Apr 19 08:06:18 user devstack@n-api.service[61210]: X-User-Id: 8043565b02bb4f63b4a0b552b7191098 Apr 19 08:06:18 user devstack@n-api.service[61210]: X-User-Name: tempest-SnapshotDataIntegrityTests-1194625945-project-member Apr 19 08:06:18 user devstack@n-api.service[61210]: method: > Apr 19 08:06:18 user devstack@n-api.service[61210]: exception: Instance bb5de453-e849-4495-8e25-6d3b0e8c3569 could not be found. Apr 19 08:06:18 user devstack@n-api.service[61210]: action_args: {'id': 'bb5de453-e849-4495-8e25-6d3b0e8c3569'} Apr 19 08:06:18 user devstack@n-api.service[61210]: {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb5de453-e849-4495-8e25-6d3b0e8c3569 could not be found. Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb5de453-e849-4495-8e25-6d3b0e8c3569 could not be found. Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb5de453-e849-4495-8e25-6d3b0e8c3569 could not be found. Apr 19 08:06:18 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:06:18 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-e44328b5-7402-48bf-b4b8-6b89702298a8 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Returning 404 to user: Instance bb5de453-e849-4495-8e25-6d3b0e8c3569 could not be found. {{(pid=61210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:06:18 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-e44328b5-7402-48bf-b4b8-6b89702298a8 tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb5de453-e849-4495-8e25-6d3b0e8c3569" status: 404 len: 111 microversion: 2.1 time: 0.025859 Apr 19 08:06:18 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 96/284] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:06:18 2023] GET /compute/v2.1/servers/bb5de453-e849-4495-8e25-6d3b0e8c3569 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:06:18 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-17c2ee4f-393c-4627-8bde-a65a0a8456fa tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] Calling method '.version_select at 0x7f2c00f4d900>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:06:18 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-17c2ee4f-393c-4627-8bde-a65a0a8456fa tempest-SnapshotDataIntegrityTests-1194625945 tempest-SnapshotDataIntegrityTests-1194625945-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1853359407" status: 202 len: 0 microversion: 2.1 time: 0.025606 Apr 19 08:06:18 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 96/285] 10.0.0.210 () {62 vars in 1355 bytes} [Wed Apr 19 08:06:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1853359407 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 08:06:28 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:06:28 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=6 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:06:28 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-eed3161d-c792-434a-a5aa-4eef74aa13f0 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Action: 'create', calling method: .version_select at 0x7f2c010cc940>, body: {"keypair": {"name": "tempest-keypair-337992567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLVwSIZ1oGX78CMjltJm+bvFW4GujMItlU7LEr8GJwEvbEm95hxk3j/YtZS/kaoRCB/genXxJRVmWzNZE4/edLgFBXMHzW0tvAC2DsZ3f7uQIT6m4Ph0r5i8Gnd9lkAdQ=="}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:06:28 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-eed3161d-c792-434a-a5aa-4eef74aa13f0 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Getting quotas for project f475ef63d11f4decbd33dfc63e108d12. Resources: {'key_pairs'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:06:28 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-eed3161d-c792-434a-a5aa-4eef74aa13f0 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Getting quotas for user a0d79080dd7b4e20932eb3774bdc97a4 and project f475ef63d11f4decbd33dfc63e108d12. Resources: {'key_pairs'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:06:28 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-eed3161d-c792-434a-a5aa-4eef74aa13f0 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.256506 Apr 19 08:06:28 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 94/286] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 19 08:06:28 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 258 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 19 08:06:30 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-a8e046db-a5ae-4e9f-849d-0fdb8de039c5 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-367062780", "imageRef": "b515545f-3b22-4d80-a102-6a318ab9717a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "148f1dce-55c7-456b-971d-00cad5c4c568"}], "security_groups": [{"name": "tempest-securitygroup--798791327"}], "key_name": "tempest-keypair-337992567", "user_data": "}} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:06:30 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:06:30 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=4 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:06:30 user devstack@n-api.service[61210]: DEBUG nova.network.neutron [None req-a8e046db-a5ae-4e9f-849d-0fdb8de039c5 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] validate_networks() for [('148f1dce-55c7-456b-971d-00cad5c4c568', None, None, None, None, None)] {{(pid=61210) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 08:06:30 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-a8e046db-a5ae-4e9f-849d-0fdb8de039c5 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Flavor limits 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 08:06:30 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-a8e046db-a5ae-4e9f-849d-0fdb8de039c5 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Image limits 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 08:06:30 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-a8e046db-a5ae-4e9f-849d-0fdb8de039c5 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Flavor pref 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 08:06:30 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-a8e046db-a5ae-4e9f-849d-0fdb8de039c5 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Image pref 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 08:06:30 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-a8e046db-a5ae-4e9f-849d-0fdb8de039c5 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 08:06:30 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a8e046db-a5ae-4e9f-849d-0fdb8de039c5 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:30 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a8e046db-a5ae-4e9f-849d-0fdb8de039c5 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:30 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a8e046db-a5ae-4e9f-849d-0fdb8de039c5 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:30 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a8e046db-a5ae-4e9f-849d-0fdb8de039c5 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:30 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a8e046db-a5ae-4e9f-849d-0fdb8de039c5 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:30 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-a8e046db-a5ae-4e9f-849d-0fdb8de039c5 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:30 user devstack@n-api.service[61210]: DEBUG nova.quota [None req-a8e046db-a5ae-4e9f-849d-0fdb8de039c5 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Getting quotas for project f475ef63d11f4decbd33dfc63e108d12. Resources: {'ram', 'cores', 'instances'} {{(pid=61210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:06:30 user devstack@n-api.service[61210]: DEBUG nova.quota [None req-a8e046db-a5ae-4e9f-849d-0fdb8de039c5 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Getting quotas for user a0d79080dd7b4e20932eb3774bdc97a4 and project f475ef63d11f4decbd33dfc63e108d12. Resources: {'ram', 'cores', 'instances'} {{(pid=61210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:06:30 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-a8e046db-a5ae-4e9f-849d-0fdb8de039c5 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Going to run 1 instances... {{(pid=61210) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 08:06:30 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-a8e046db-a5ae-4e9f-849d-0fdb8de039c5 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] [instance: 45c79c22-b7be-444f-8d5a-f152377c70f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b515545f-3b22-4d80-a102-6a318ab9717a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 08:06:30 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-a8e046db-a5ae-4e9f-849d-0fdb8de039c5 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.715903 Apr 19 08:06:30 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 97/287] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 08:06:30 2023] POST /compute/v2.1/servers => generated 399 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 08:06:30 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-f8fd9cb7-bc11-4abe-aac8-c6f756691866 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:06:30 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-f8fd9cb7-bc11-4abe-aac8-c6f756691866 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] [instance: 45c79c22-b7be-444f-8d5a-f152377c70f3] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:06:30 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=10 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:06:30 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:06:30 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-f8fd9cb7-bc11-4abe-aac8-c6f756691866 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d79080dd7b4e20932eb3774bdc97a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f475ef63d11f4decbd33dfc63e108d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:06:30 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-f8fd9cb7-bc11-4abe-aac8-c6f756691866 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0d79080dd7b4e20932eb3774bdc97a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f475ef63d11f4decbd33dfc63e108d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:06:30 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-f8fd9cb7-bc11-4abe-aac8-c6f756691866 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0d79080dd7b4e20932eb3774bdc97a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f475ef63d11f4decbd33dfc63e108d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:06:30 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-f8fd9cb7-bc11-4abe-aac8-c6f756691866 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/45c79c22-b7be-444f-8d5a-f152377c70f3" status: 200 len: 1274 microversion: 2.20 time: 0.075142 Apr 19 08:06:30 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 97/288] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:06:30 2023] GET /compute/v2.1/servers/45c79c22-b7be-444f-8d5a-f152377c70f3 => generated 1274 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 08:06:33 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-e74ace6a-dfed-476c-a468-409d4531ed16 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:06:33 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-e74ace6a-dfed-476c-a468-409d4531ed16 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] [instance: bdeeb437-76a3-49b5-9553-d2da74917d69] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:06:33 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e74ace6a-dfed-476c-a468-409d4531ed16 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:33 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e74ace6a-dfed-476c-a468-409d4531ed16 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:33 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e74ace6a-dfed-476c-a468-409d4531ed16 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:33 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e74ace6a-dfed-476c-a468-409d4531ed16 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:33 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e74ace6a-dfed-476c-a468-409d4531ed16 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:33 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e74ace6a-dfed-476c-a468-409d4531ed16 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:33 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-e74ace6a-dfed-476c-a468-409d4531ed16 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dc2a88f2d149a1a4035ed1c7e74b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcde8c2a3444e919d232ea854c00e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:06:33 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-e74ace6a-dfed-476c-a468-409d4531ed16 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69" status: 200 len: 1658 microversion: 2.1 time: 0.220289 Apr 19 08:06:33 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 95/289] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:06:33 2023] GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69 => generated 1658 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:06:33 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-730cf1ce-0277-45f0-8f56-6c3e3f2a5356 req-0714d5af-ca62-4ed9-8da9-0271e129d31a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45c79c22-b7be-444f-8d5a-f152377c70f3", "tag": "16e696e9-a55e-4c09-85cb-c24ad488eede"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:06:33 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-730cf1ce-0277-45f0-8f56-6c3e3f2a5356 req-0714d5af-ca62-4ed9-8da9-0271e129d31a service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:33 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-730cf1ce-0277-45f0-8f56-6c3e3f2a5356 req-0714d5af-ca62-4ed9-8da9-0271e129d31a service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:33 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-730cf1ce-0277-45f0-8f56-6c3e3f2a5356 req-0714d5af-ca62-4ed9-8da9-0271e129d31a service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:33 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-730cf1ce-0277-45f0-8f56-6c3e3f2a5356 req-0714d5af-ca62-4ed9-8da9-0271e129d31a service nova] Creating event network-changed:16e696e9-a55e-4c09-85cb-c24ad488eede for instance 45c79c22-b7be-444f-8d5a-f152377c70f3 on user Apr 19 08:06:33 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-730cf1ce-0277-45f0-8f56-6c3e3f2a5356 req-0714d5af-ca62-4ed9-8da9-0271e129d31a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032104 Apr 19 08:06:33 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 98/290] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:06:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:06:35 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-7e9694dd-10b9-48ed-b03b-70799dc016fb req-0fa8922b-5c74-4295-8c98-5d127a397e97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c79c22-b7be-444f-8d5a-f152377c70f3", "name": "network-vif-plugged", "status": "completed", "tag": "16e696e9-a55e-4c09-85cb-c24ad488eede"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:06:35 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-7e9694dd-10b9-48ed-b03b-70799dc016fb req-0fa8922b-5c74-4295-8c98-5d127a397e97 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:35 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-7e9694dd-10b9-48ed-b03b-70799dc016fb req-0fa8922b-5c74-4295-8c98-5d127a397e97 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:35 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-7e9694dd-10b9-48ed-b03b-70799dc016fb req-0fa8922b-5c74-4295-8c98-5d127a397e97 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:35 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-7e9694dd-10b9-48ed-b03b-70799dc016fb req-0fa8922b-5c74-4295-8c98-5d127a397e97 service nova] Creating event network-vif-plugged:16e696e9-a55e-4c09-85cb-c24ad488eede for instance 45c79c22-b7be-444f-8d5a-f152377c70f3 on user Apr 19 08:06:35 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-7e9694dd-10b9-48ed-b03b-70799dc016fb req-0fa8922b-5c74-4295-8c98-5d127a397e97 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167364 Apr 19 08:06:35 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 98/291] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:06:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:06:37 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-11cff763-864a-401b-a313-3e2bc39b85b9 req-08a00225-8560-4556-9331-19801b08f727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c79c22-b7be-444f-8d5a-f152377c70f3", "name": "network-vif-plugged", "status": "completed", "tag": "16e696e9-a55e-4c09-85cb-c24ad488eede"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:06:37 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-11cff763-864a-401b-a313-3e2bc39b85b9 req-08a00225-8560-4556-9331-19801b08f727 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:37 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-11cff763-864a-401b-a313-3e2bc39b85b9 req-08a00225-8560-4556-9331-19801b08f727 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:37 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-11cff763-864a-401b-a313-3e2bc39b85b9 req-08a00225-8560-4556-9331-19801b08f727 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:37 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-11cff763-864a-401b-a313-3e2bc39b85b9 req-08a00225-8560-4556-9331-19801b08f727 service nova] Creating event network-vif-plugged:16e696e9-a55e-4c09-85cb-c24ad488eede for instance 45c79c22-b7be-444f-8d5a-f152377c70f3 on user Apr 19 08:06:37 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-11cff763-864a-401b-a313-3e2bc39b85b9 req-08a00225-8560-4556-9331-19801b08f727 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028446 Apr 19 08:06:37 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 96/292] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:06:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:06:39 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-f6b36190-1398-45d0-94c0-9ce430fef9a4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2038795072", "imageRef": "b515545f-3b22-4d80-a102-6a318ab9717a", "flavorRef": "42", "networks": [{"uuid": "d4c2bd9d-7482-4ff6-9de8-da32da3110f7"}]}} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:06:39 user devstack@n-api.service[61210]: DEBUG nova.network.neutron [None req-f6b36190-1398-45d0-94c0-9ce430fef9a4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] validate_networks() for [('d4c2bd9d-7482-4ff6-9de8-da32da3110f7', None, None, None, None, None)] {{(pid=61210) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 08:06:40 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-f6b36190-1398-45d0-94c0-9ce430fef9a4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Flavor limits 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 08:06:40 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-f6b36190-1398-45d0-94c0-9ce430fef9a4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Image limits 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 08:06:40 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-f6b36190-1398-45d0-94c0-9ce430fef9a4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Flavor pref 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 08:06:40 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-f6b36190-1398-45d0-94c0-9ce430fef9a4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Image pref 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 08:06:40 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-f6b36190-1398-45d0-94c0-9ce430fef9a4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 08:06:40 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f6b36190-1398-45d0-94c0-9ce430fef9a4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:40 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f6b36190-1398-45d0-94c0-9ce430fef9a4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:40 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f6b36190-1398-45d0-94c0-9ce430fef9a4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:40 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f6b36190-1398-45d0-94c0-9ce430fef9a4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:40 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f6b36190-1398-45d0-94c0-9ce430fef9a4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:40 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f6b36190-1398-45d0-94c0-9ce430fef9a4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:40 user devstack@n-api.service[61210]: DEBUG nova.quota [None req-f6b36190-1398-45d0-94c0-9ce430fef9a4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Getting quotas for project 789f98320d1745918cc7e2ca0ddf0ca8. Resources: {'ram', 'cores', 'instances'} {{(pid=61210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:06:40 user devstack@n-api.service[61210]: DEBUG nova.quota [None req-f6b36190-1398-45d0-94c0-9ce430fef9a4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Getting quotas for user 2027c586717a407baa7cd8f3cdc56459 and project 789f98320d1745918cc7e2ca0ddf0ca8. Resources: {'ram', 'cores', 'instances'} {{(pid=61210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:06:40 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-f6b36190-1398-45d0-94c0-9ce430fef9a4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Going to run 1 instances... {{(pid=61210) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 08:06:40 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-f6b36190-1398-45d0-94c0-9ce430fef9a4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] [instance: 60cdd0c0-d5ec-4744-932e-61cb5c48d457] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b515545f-3b22-4d80-a102-6a318ab9717a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 08:06:40 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-f6b36190-1398-45d0-94c0-9ce430fef9a4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.624722 Apr 19 08:06:40 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 99/293] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 08:06:39 2023] POST /compute/v2.1/servers => generated 378 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 08:06:40 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-1d662eca-3eb7-406f-8bdc-56d9e76cdeb7 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:06:40 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-1d662eca-3eb7-406f-8bdc-56d9e76cdeb7 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] [instance: 60cdd0c0-d5ec-4744-932e-61cb5c48d457] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:06:40 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-1d662eca-3eb7-406f-8bdc-56d9e76cdeb7 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2027c586717a407baa7cd8f3cdc56459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f98320d1745918cc7e2ca0ddf0ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:06:40 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-1d662eca-3eb7-406f-8bdc-56d9e76cdeb7 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/60cdd0c0-d5ec-4744-932e-61cb5c48d457" status: 200 len: 1211 microversion: 2.1 time: 0.069800 Apr 19 08:06:40 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 99/294] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:06:40 2023] GET /compute/v2.1/servers/60cdd0c0-d5ec-4744-932e-61cb5c48d457 => generated 1211 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:06:42 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=4 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:06:42 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-c14bd359-41d9-405d-9f50-532b7afcd2d9 req-7e907042-b518-452b-84d2-61daf099815e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60cdd0c0-d5ec-4744-932e-61cb5c48d457", "tag": "8648e8f8-b9bc-41e0-819b-68f3bcdd6424"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:06:42 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-c14bd359-41d9-405d-9f50-532b7afcd2d9 req-7e907042-b518-452b-84d2-61daf099815e service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:42 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-c14bd359-41d9-405d-9f50-532b7afcd2d9 req-7e907042-b518-452b-84d2-61daf099815e service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:42 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-c14bd359-41d9-405d-9f50-532b7afcd2d9 req-7e907042-b518-452b-84d2-61daf099815e service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:42 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-c14bd359-41d9-405d-9f50-532b7afcd2d9 req-7e907042-b518-452b-84d2-61daf099815e service nova] Creating event network-changed:8648e8f8-b9bc-41e0-819b-68f3bcdd6424 for instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 on user Apr 19 08:06:42 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-c14bd359-41d9-405d-9f50-532b7afcd2d9 req-7e907042-b518-452b-84d2-61daf099815e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028751 Apr 19 08:06:42 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 97/295] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:06:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:06:44 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-63094640-af22-428e-b417-f1783548a5ca req-42d900ac-c987-444b-8911-a92b9cdc7f59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60cdd0c0-d5ec-4744-932e-61cb5c48d457", "name": "network-vif-plugged", "status": "completed", "tag": "8648e8f8-b9bc-41e0-819b-68f3bcdd6424"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:06:44 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-63094640-af22-428e-b417-f1783548a5ca req-42d900ac-c987-444b-8911-a92b9cdc7f59 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:44 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-63094640-af22-428e-b417-f1783548a5ca req-42d900ac-c987-444b-8911-a92b9cdc7f59 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:44 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-63094640-af22-428e-b417-f1783548a5ca req-42d900ac-c987-444b-8911-a92b9cdc7f59 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:44 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-63094640-af22-428e-b417-f1783548a5ca req-42d900ac-c987-444b-8911-a92b9cdc7f59 service nova] Creating event network-vif-plugged:8648e8f8-b9bc-41e0-819b-68f3bcdd6424 for instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 on user Apr 19 08:06:44 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-63094640-af22-428e-b417-f1783548a5ca req-42d900ac-c987-444b-8911-a92b9cdc7f59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032392 Apr 19 08:06:44 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 100/296] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:06:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:06:46 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-d190cc98-e63a-456f-9273-01edb8e72386 req-2adda8a7-08fe-46c7-9227-73f4642ac5fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60cdd0c0-d5ec-4744-932e-61cb5c48d457", "name": "network-vif-plugged", "status": "completed", "tag": "8648e8f8-b9bc-41e0-819b-68f3bcdd6424"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:06:46 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:06:46 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-d190cc98-e63a-456f-9273-01edb8e72386 req-2adda8a7-08fe-46c7-9227-73f4642ac5fc service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:46 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-d190cc98-e63a-456f-9273-01edb8e72386 req-2adda8a7-08fe-46c7-9227-73f4642ac5fc service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:46 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-d190cc98-e63a-456f-9273-01edb8e72386 req-2adda8a7-08fe-46c7-9227-73f4642ac5fc service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:46 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-d190cc98-e63a-456f-9273-01edb8e72386 req-2adda8a7-08fe-46c7-9227-73f4642ac5fc service nova] Creating event network-vif-plugged:8648e8f8-b9bc-41e0-819b-68f3bcdd6424 for instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 on user Apr 19 08:06:46 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-d190cc98-e63a-456f-9273-01edb8e72386 req-2adda8a7-08fe-46c7-9227-73f4642ac5fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030146 Apr 19 08:06:46 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 100/297] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:06:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:06:52 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-a9b68cc4-6c13-406a-99dd-0f08df6a5bed tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:06:52 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-a9b68cc4-6c13-406a-99dd-0f08df6a5bed tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 3f04177b-d122-459b-871c-15c0964d793a] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:06:52 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-a9b68cc4-6c13-406a-99dd-0f08df6a5bed tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:52 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-a9b68cc4-6c13-406a-99dd-0f08df6a5bed tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:52 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-a9b68cc4-6c13-406a-99dd-0f08df6a5bed tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:52 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-a9b68cc4-6c13-406a-99dd-0f08df6a5bed tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:06:52 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-a9b68cc4-6c13-406a-99dd-0f08df6a5bed tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:06:52 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-a9b68cc4-6c13-406a-99dd-0f08df6a5bed tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:06:52 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-a9b68cc4-6c13-406a-99dd-0f08df6a5bed tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:06:52 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-a9b68cc4-6c13-406a-99dd-0f08df6a5bed tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:06:52 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-a9b68cc4-6c13-406a-99dd-0f08df6a5bed tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:06:52 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-a9b68cc4-6c13-406a-99dd-0f08df6a5bed tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f04177b-d122-459b-871c-15c0964d793a" status: 200 len: 1691 microversion: 2.87 time: 0.270639 Apr 19 08:06:52 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 98/298] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:06:52 2023] GET /compute/v2.1/servers/3f04177b-d122-459b-871c-15c0964d793a => generated 1691 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 08:07:20 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell0:SELECT=4 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:07:20 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell0:SELECT=12 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:07:20 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=6 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:07:20 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=8 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:07:20 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-932008ce-2e2c-481e-83bb-36e7d3af231d tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:07:20 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-932008ce-2e2c-481e-83bb-36e7d3af231d tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] [instance: 45c79c22-b7be-444f-8d5a-f152377c70f3] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:07:20 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-932008ce-2e2c-481e-83bb-36e7d3af231d tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:07:20 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-932008ce-2e2c-481e-83bb-36e7d3af231d tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:07:20 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-932008ce-2e2c-481e-83bb-36e7d3af231d tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:07:20 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-932008ce-2e2c-481e-83bb-36e7d3af231d tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:07:20 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-932008ce-2e2c-481e-83bb-36e7d3af231d tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:07:20 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-932008ce-2e2c-481e-83bb-36e7d3af231d tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:07:21 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-932008ce-2e2c-481e-83bb-36e7d3af231d tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d79080dd7b4e20932eb3774bdc97a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f475ef63d11f4decbd33dfc63e108d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:07:21 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-932008ce-2e2c-481e-83bb-36e7d3af231d tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0d79080dd7b4e20932eb3774bdc97a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f475ef63d11f4decbd33dfc63e108d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:07:21 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-932008ce-2e2c-481e-83bb-36e7d3af231d tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0d79080dd7b4e20932eb3774bdc97a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f475ef63d11f4decbd33dfc63e108d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:07:21 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-932008ce-2e2c-481e-83bb-36e7d3af231d tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/45c79c22-b7be-444f-8d5a-f152377c70f3" status: 200 len: 1585 microversion: 2.20 time: 0.315092 Apr 19 08:07:21 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 101/299] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:07:20 2023] GET /compute/v2.1/servers/45c79c22-b7be-444f-8d5a-f152377c70f3 => generated 1585 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 08:07:30 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=4 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:07:30 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=12 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:07:30 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:07:30 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-3ea13889-448f-4184-8b26-8b1a9d2d3735 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:07:30 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-3ea13889-448f-4184-8b26-8b1a9d2d3735 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] [instance: 60cdd0c0-d5ec-4744-932e-61cb5c48d457] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:07:30 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-3ea13889-448f-4184-8b26-8b1a9d2d3735 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:07:30 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-3ea13889-448f-4184-8b26-8b1a9d2d3735 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:07:30 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-3ea13889-448f-4184-8b26-8b1a9d2d3735 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:07:30 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-3ea13889-448f-4184-8b26-8b1a9d2d3735 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:07:30 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-3ea13889-448f-4184-8b26-8b1a9d2d3735 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:07:30 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-3ea13889-448f-4184-8b26-8b1a9d2d3735 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:07:30 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-3ea13889-448f-4184-8b26-8b1a9d2d3735 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2027c586717a407baa7cd8f3cdc56459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f98320d1745918cc7e2ca0ddf0ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:07:30 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-3ea13889-448f-4184-8b26-8b1a9d2d3735 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/60cdd0c0-d5ec-4744-932e-61cb5c48d457" status: 200 len: 1494 microversion: 2.1 time: 0.238105 Apr 19 08:07:30 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 101/300] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:07:30 2023] GET /compute/v2.1/servers/60cdd0c0-d5ec-4744-932e-61cb5c48d457 => generated 1494 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:07:33 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-e1c2037f-4080-44b6-a907-de2729032d48 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:07:33 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-e1c2037f-4080-44b6-a907-de2729032d48 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] [instance: bdeeb437-76a3-49b5-9553-d2da74917d69] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:07:33 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=16 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:07:33 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:07:33 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e1c2037f-4080-44b6-a907-de2729032d48 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:07:33 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e1c2037f-4080-44b6-a907-de2729032d48 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:07:33 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e1c2037f-4080-44b6-a907-de2729032d48 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:07:33 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e1c2037f-4080-44b6-a907-de2729032d48 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:07:33 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e1c2037f-4080-44b6-a907-de2729032d48 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:07:33 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e1c2037f-4080-44b6-a907-de2729032d48 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:07:33 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-e1c2037f-4080-44b6-a907-de2729032d48 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dc2a88f2d149a1a4035ed1c7e74b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcde8c2a3444e919d232ea854c00e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:07:33 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-e1c2037f-4080-44b6-a907-de2729032d48 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69" status: 200 len: 1658 microversion: 2.1 time: 0.233714 Apr 19 08:07:33 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 99/301] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:07:33 2023] GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69 => generated 1658 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:07:33 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-f0729faf-4bdf-486b-b1a0-55832f8a0eba tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:07:33 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-f0729faf-4bdf-486b-b1a0-55832f8a0eba tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] [instance: bdeeb437-76a3-49b5-9553-d2da74917d69] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:07:33 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=2 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:07:33 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=6 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:07:33 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f0729faf-4bdf-486b-b1a0-55832f8a0eba tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:07:33 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f0729faf-4bdf-486b-b1a0-55832f8a0eba tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:07:33 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f0729faf-4bdf-486b-b1a0-55832f8a0eba tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:07:33 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f0729faf-4bdf-486b-b1a0-55832f8a0eba tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:07:33 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f0729faf-4bdf-486b-b1a0-55832f8a0eba tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:07:33 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f0729faf-4bdf-486b-b1a0-55832f8a0eba tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:07:33 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-f0729faf-4bdf-486b-b1a0-55832f8a0eba tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dc2a88f2d149a1a4035ed1c7e74b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcde8c2a3444e919d232ea854c00e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:07:33 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-f0729faf-4bdf-486b-b1a0-55832f8a0eba tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69" status: 200 len: 1658 microversion: 2.1 time: 0.222056 Apr 19 08:07:33 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 102/302] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:07:33 2023] GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69 => generated 1658 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:07:33 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-62ffe2e5-e767-4f82-8fdf-aad9787596a4 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:07:33 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-62ffe2e5-e767-4f82-8fdf-aad9787596a4 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] [instance: bdeeb437-76a3-49b5-9553-d2da74917d69] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:07:33 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-62ffe2e5-e767-4f82-8fdf-aad9787596a4 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:07:33 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-62ffe2e5-e767-4f82-8fdf-aad9787596a4 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:07:33 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-62ffe2e5-e767-4f82-8fdf-aad9787596a4 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:07:33 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-62ffe2e5-e767-4f82-8fdf-aad9787596a4 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:07:33 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-62ffe2e5-e767-4f82-8fdf-aad9787596a4 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:07:33 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-62ffe2e5-e767-4f82-8fdf-aad9787596a4 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:07:34 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-62ffe2e5-e767-4f82-8fdf-aad9787596a4 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dc2a88f2d149a1a4035ed1c7e74b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcde8c2a3444e919d232ea854c00e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:07:34 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-62ffe2e5-e767-4f82-8fdf-aad9787596a4 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69" status: 200 len: 1658 microversion: 2.1 time: 0.228659 Apr 19 08:07:34 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 102/303] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:07:33 2023] GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69 => generated 1658 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:07:52 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-481cda20-e297-4513-8011-cd916715f810 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-444178090"}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:07:52 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-481cda20-e297-4513-8011-cd916715f810 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 3f04177b-d122-459b-871c-15c0964d793a] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:07:52 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:07:52 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=6 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:07:52 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-481cda20-e297-4513-8011-cd916715f810 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:07:52 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-481cda20-e297-4513-8011-cd916715f810 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:07:52 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-481cda20-e297-4513-8011-cd916715f810 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:07:52 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-481cda20-e297-4513-8011-cd916715f810 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:07:52 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-481cda20-e297-4513-8011-cd916715f810 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:07:52 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-481cda20-e297-4513-8011-cd916715f810 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:07:53 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-481cda20-e297-4513-8011-cd916715f810 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3f04177b-d122-459b-871c-15c0964d793a/action" status: 202 len: 52 microversion: 2.87 time: 0.851644 Apr 19 08:07:53 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 100/304] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 19 08:07:52 2023] POST /compute/v2.1/servers/3f04177b-d122-459b-871c-15c0964d793a/action => generated 52 bytes in 854 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 19 08:07:58 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-1eb9f7dc-6967-4278-9b0e-0e12aec7e7d8 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:07:58 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-1eb9f7dc-6967-4278-9b0e-0e12aec7e7d8 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 3f04177b-d122-459b-871c-15c0964d793a] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:07:58 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=2 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:07:58 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=6 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:07:58 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-1eb9f7dc-6967-4278-9b0e-0e12aec7e7d8 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:07:58 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-1eb9f7dc-6967-4278-9b0e-0e12aec7e7d8 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:07:58 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-1eb9f7dc-6967-4278-9b0e-0e12aec7e7d8 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:07:58 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-1eb9f7dc-6967-4278-9b0e-0e12aec7e7d8 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:07:58 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-1eb9f7dc-6967-4278-9b0e-0e12aec7e7d8 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:07:58 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-1eb9f7dc-6967-4278-9b0e-0e12aec7e7d8 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:07:58 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-1eb9f7dc-6967-4278-9b0e-0e12aec7e7d8 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:07:58 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-1eb9f7dc-6967-4278-9b0e-0e12aec7e7d8 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:07:58 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-1eb9f7dc-6967-4278-9b0e-0e12aec7e7d8 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:07:58 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-1eb9f7dc-6967-4278-9b0e-0e12aec7e7d8 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f04177b-d122-459b-871c-15c0964d793a" status: 200 len: 1691 microversion: 2.87 time: 0.283759 Apr 19 08:07:58 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 103/305] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:07:58 2023] GET /compute/v2.1/servers/3f04177b-d122-459b-871c-15c0964d793a => generated 1691 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 08:08:21 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-6aa27c31-a631-4e32-9e16-89a52774295b tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:08:21 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-6aa27c31-a631-4e32-9e16-89a52774295b tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] [instance: 45c79c22-b7be-444f-8d5a-f152377c70f3] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:08:21 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=4 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:08:21 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=12 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:08:21 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-6aa27c31-a631-4e32-9e16-89a52774295b tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:08:21 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-6aa27c31-a631-4e32-9e16-89a52774295b tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:08:21 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-6aa27c31-a631-4e32-9e16-89a52774295b tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:08:21 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-6aa27c31-a631-4e32-9e16-89a52774295b tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:08:21 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-6aa27c31-a631-4e32-9e16-89a52774295b tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:08:21 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-6aa27c31-a631-4e32-9e16-89a52774295b tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:08:21 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-6aa27c31-a631-4e32-9e16-89a52774295b tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/45c79c22-b7be-444f-8d5a-f152377c70f3/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.178920 Apr 19 08:08:21 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 103/306] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 19 08:08:21 2023] GET /compute/v2.1/servers/45c79c22-b7be-444f-8d5a-f152377c70f3/os-interface => generated 283 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 08:08:22 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:08:22 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:08:22 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-a308f77c-bbf5-437e-8043-259429bb89d3 req-4bb3e1d0-8987-451b-b288-44a0ba8726b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45c79c22-b7be-444f-8d5a-f152377c70f3", "tag": "16e696e9-a55e-4c09-85cb-c24ad488eede"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:08:22 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-a308f77c-bbf5-437e-8043-259429bb89d3 req-4bb3e1d0-8987-451b-b288-44a0ba8726b8 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:08:22 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-a308f77c-bbf5-437e-8043-259429bb89d3 req-4bb3e1d0-8987-451b-b288-44a0ba8726b8 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:08:22 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-a308f77c-bbf5-437e-8043-259429bb89d3 req-4bb3e1d0-8987-451b-b288-44a0ba8726b8 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:08:22 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-a308f77c-bbf5-437e-8043-259429bb89d3 req-4bb3e1d0-8987-451b-b288-44a0ba8726b8 service nova] Creating event network-changed:16e696e9-a55e-4c09-85cb-c24ad488eede for instance 45c79c22-b7be-444f-8d5a-f152377c70f3 on user Apr 19 08:08:22 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-a308f77c-bbf5-437e-8043-259429bb89d3 req-4bb3e1d0-8987-451b-b288-44a0ba8726b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040779 Apr 19 08:08:22 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 101/307] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:08:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 08:08:22 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-d627706a-845c-4166-bb13-0288dfc2ded6 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:08:22 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-d627706a-845c-4166-bb13-0288dfc2ded6 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] [instance: 45c79c22-b7be-444f-8d5a-f152377c70f3] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:08:22 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=6 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:08:22 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=4 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:08:22 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-d627706a-845c-4166-bb13-0288dfc2ded6 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:08:22 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-d627706a-845c-4166-bb13-0288dfc2ded6 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:08:22 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-d627706a-845c-4166-bb13-0288dfc2ded6 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:08:22 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-d627706a-845c-4166-bb13-0288dfc2ded6 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:08:22 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-d627706a-845c-4166-bb13-0288dfc2ded6 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:08:22 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-d627706a-845c-4166-bb13-0288dfc2ded6 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:08:22 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-d627706a-845c-4166-bb13-0288dfc2ded6 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/45c79c22-b7be-444f-8d5a-f152377c70f3/ips" status: 200 len: 110 microversion: 2.20 time: 0.038018 Apr 19 08:08:22 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 104/308] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 19 08:08:22 2023] GET /compute/v2.1/servers/45c79c22-b7be-444f-8d5a-f152377c70f3/ips => generated 110 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 08:08:24 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-7ecea828-a631-41de-9f0b-ef992a1f5bf2 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:08:24 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-7ecea828-a631-41de-9f0b-ef992a1f5bf2 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] [instance: 45c79c22-b7be-444f-8d5a-f152377c70f3] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:08:24 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7ecea828-a631-41de-9f0b-ef992a1f5bf2 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:08:24 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7ecea828-a631-41de-9f0b-ef992a1f5bf2 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:08:24 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7ecea828-a631-41de-9f0b-ef992a1f5bf2 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:08:24 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7ecea828-a631-41de-9f0b-ef992a1f5bf2 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:08:24 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7ecea828-a631-41de-9f0b-ef992a1f5bf2 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:08:24 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7ecea828-a631-41de-9f0b-ef992a1f5bf2 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:08:24 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-7ecea828-a631-41de-9f0b-ef992a1f5bf2 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] [instance: 45c79c22-b7be-444f-8d5a-f152377c70f3] Going to try to terminate instance {{(pid=61208) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:08:24 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-7ecea828-a631-41de-9f0b-ef992a1f5bf2 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/45c79c22-b7be-444f-8d5a-f152377c70f3" status: 204 len: 0 microversion: 2.20 time: 0.126740 Apr 19 08:08:24 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 104/309] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 08:08:24 2023] DELETE /compute/v2.1/servers/45c79c22-b7be-444f-8d5a-f152377c70f3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 08:08:24 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-32550b1f-89de-4c70-b601-19b10ec7cf91 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:08:24 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-32550b1f-89de-4c70-b601-19b10ec7cf91 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] [instance: 45c79c22-b7be-444f-8d5a-f152377c70f3] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:08:24 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-32550b1f-89de-4c70-b601-19b10ec7cf91 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:08:24 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-32550b1f-89de-4c70-b601-19b10ec7cf91 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:08:24 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-32550b1f-89de-4c70-b601-19b10ec7cf91 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:08:24 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-32550b1f-89de-4c70-b601-19b10ec7cf91 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:08:24 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-32550b1f-89de-4c70-b601-19b10ec7cf91 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:08:24 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-32550b1f-89de-4c70-b601-19b10ec7cf91 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:08:24 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-c1a5dbd9-7311-474b-82de-20fe264f2381 req-a08cc495-eabb-4fa0-bd68-1daff216052c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c79c22-b7be-444f-8d5a-f152377c70f3", "name": "network-vif-unplugged", "status": "completed", "tag": "16e696e9-a55e-4c09-85cb-c24ad488eede"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:08:24 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-c1a5dbd9-7311-474b-82de-20fe264f2381 req-a08cc495-eabb-4fa0-bd68-1daff216052c service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:08:24 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-c1a5dbd9-7311-474b-82de-20fe264f2381 req-a08cc495-eabb-4fa0-bd68-1daff216052c service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:08:24 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-c1a5dbd9-7311-474b-82de-20fe264f2381 req-a08cc495-eabb-4fa0-bd68-1daff216052c service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:08:24 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-c1a5dbd9-7311-474b-82de-20fe264f2381 req-a08cc495-eabb-4fa0-bd68-1daff216052c service nova] Creating event network-vif-unplugged:16e696e9-a55e-4c09-85cb-c24ad488eede for instance 45c79c22-b7be-444f-8d5a-f152377c70f3 on user Apr 19 08:08:24 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-c1a5dbd9-7311-474b-82de-20fe264f2381 req-a08cc495-eabb-4fa0-bd68-1daff216052c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035233 Apr 19 08:08:24 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 105/310] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:08:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:08:24 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-32550b1f-89de-4c70-b601-19b10ec7cf91 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d79080dd7b4e20932eb3774bdc97a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f475ef63d11f4decbd33dfc63e108d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:08:24 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-32550b1f-89de-4c70-b601-19b10ec7cf91 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0d79080dd7b4e20932eb3774bdc97a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f475ef63d11f4decbd33dfc63e108d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:08:24 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-32550b1f-89de-4c70-b601-19b10ec7cf91 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0d79080dd7b4e20932eb3774bdc97a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f475ef63d11f4decbd33dfc63e108d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:08:24 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-32550b1f-89de-4c70-b601-19b10ec7cf91 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/45c79c22-b7be-444f-8d5a-f152377c70f3" status: 200 len: 1710 microversion: 2.20 time: 0.358803 Apr 19 08:08:24 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 102/311] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:08:24 2023] GET /compute/v2.1/servers/45c79c22-b7be-444f-8d5a-f152377c70f3 => generated 1710 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 08:08:25 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-be59f53d-0c56-4e38-a9fc-60b429816675 req-47166d22-780a-44ee-8a0b-66e4dd1700ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c79c22-b7be-444f-8d5a-f152377c70f3", "name": "network-vif-deleted", "tag": "16e696e9-a55e-4c09-85cb-c24ad488eede"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:08:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-be59f53d-0c56-4e38-a9fc-60b429816675 req-47166d22-780a-44ee-8a0b-66e4dd1700ae service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:08:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-be59f53d-0c56-4e38-a9fc-60b429816675 req-47166d22-780a-44ee-8a0b-66e4dd1700ae service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:08:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-be59f53d-0c56-4e38-a9fc-60b429816675 req-47166d22-780a-44ee-8a0b-66e4dd1700ae service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:08:25 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-be59f53d-0c56-4e38-a9fc-60b429816675 req-47166d22-780a-44ee-8a0b-66e4dd1700ae service nova] Creating event network-vif-deleted:16e696e9-a55e-4c09-85cb-c24ad488eede for instance 45c79c22-b7be-444f-8d5a-f152377c70f3 on user Apr 19 08:08:25 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-be59f53d-0c56-4e38-a9fc-60b429816675 req-47166d22-780a-44ee-8a0b-66e4dd1700ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035065 Apr 19 08:08:25 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 105/312] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:08:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:08:26 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-56ad9538-6921-432b-a8b5-b73a3f4f236b req-b41e10ab-34de-40ca-8a5b-af9dde3c1a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c79c22-b7be-444f-8d5a-f152377c70f3", "name": "network-vif-plugged", "status": "completed", "tag": "16e696e9-a55e-4c09-85cb-c24ad488eede"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:08:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-56ad9538-6921-432b-a8b5-b73a3f4f236b req-b41e10ab-34de-40ca-8a5b-af9dde3c1a31 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:08:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-56ad9538-6921-432b-a8b5-b73a3f4f236b req-b41e10ab-34de-40ca-8a5b-af9dde3c1a31 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:08:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-56ad9538-6921-432b-a8b5-b73a3f4f236b req-b41e10ab-34de-40ca-8a5b-af9dde3c1a31 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:08:26 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-56ad9538-6921-432b-a8b5-b73a3f4f236b req-b41e10ab-34de-40ca-8a5b-af9dde3c1a31 service nova] Creating event network-vif-plugged:16e696e9-a55e-4c09-85cb-c24ad488eede for instance 45c79c22-b7be-444f-8d5a-f152377c70f3 on user Apr 19 08:08:26 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-56ad9538-6921-432b-a8b5-b73a3f4f236b req-b41e10ab-34de-40ca-8a5b-af9dde3c1a31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028420 Apr 19 08:08:26 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 106/313] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:08:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:08:30 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-7c9b0ce4-3401-4c43-8c5c-eb1d89c530af tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:08:30 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-7c9b0ce4-3401-4c43-8c5c-eb1d89c530af tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] [instance: 60cdd0c0-d5ec-4744-932e-61cb5c48d457] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:08:30 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-7c9b0ce4-3401-4c43-8c5c-eb1d89c530af tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:08:30 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-7c9b0ce4-3401-4c43-8c5c-eb1d89c530af tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:08:30 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-7c9b0ce4-3401-4c43-8c5c-eb1d89c530af tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:08:30 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-7c9b0ce4-3401-4c43-8c5c-eb1d89c530af tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:08:30 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-7c9b0ce4-3401-4c43-8c5c-eb1d89c530af tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:08:30 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-7c9b0ce4-3401-4c43-8c5c-eb1d89c530af tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:08:30 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-7c9b0ce4-3401-4c43-8c5c-eb1d89c530af tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] [instance: 60cdd0c0-d5ec-4744-932e-61cb5c48d457] Going to try to terminate instance {{(pid=61209) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:08:30 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-7c9b0ce4-3401-4c43-8c5c-eb1d89c530af tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/60cdd0c0-d5ec-4744-932e-61cb5c48d457" status: 204 len: 0 microversion: 2.1 time: 0.131976 Apr 19 08:08:30 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 103/314] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:08:30 2023] DELETE /compute/v2.1/servers/60cdd0c0-d5ec-4744-932e-61cb5c48d457 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 08:08:30 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-63ad0220-b4c7-4538-aa99-66d9608fb9db tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:08:30 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-63ad0220-b4c7-4538-aa99-66d9608fb9db tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] [instance: 60cdd0c0-d5ec-4744-932e-61cb5c48d457] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:08:30 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-63ad0220-b4c7-4538-aa99-66d9608fb9db tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:08:30 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-63ad0220-b4c7-4538-aa99-66d9608fb9db tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:08:30 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-63ad0220-b4c7-4538-aa99-66d9608fb9db tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:08:30 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-63ad0220-b4c7-4538-aa99-66d9608fb9db tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:08:30 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-63ad0220-b4c7-4538-aa99-66d9608fb9db tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:08:30 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-63ad0220-b4c7-4538-aa99-66d9608fb9db tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:08:31 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-bf3a845b-616a-4c3e-82c7-f10f71317337 req-62587458-656c-4665-9db9-0cdc896e8fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60cdd0c0-d5ec-4744-932e-61cb5c48d457", "name": "network-vif-unplugged", "status": "completed", "tag": "8648e8f8-b9bc-41e0-819b-68f3bcdd6424"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:08:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-bf3a845b-616a-4c3e-82c7-f10f71317337 req-62587458-656c-4665-9db9-0cdc896e8fac service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:08:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-bf3a845b-616a-4c3e-82c7-f10f71317337 req-62587458-656c-4665-9db9-0cdc896e8fac service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:08:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-bf3a845b-616a-4c3e-82c7-f10f71317337 req-62587458-656c-4665-9db9-0cdc896e8fac service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:08:31 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-bf3a845b-616a-4c3e-82c7-f10f71317337 req-62587458-656c-4665-9db9-0cdc896e8fac service nova] Creating event network-vif-unplugged:8648e8f8-b9bc-41e0-819b-68f3bcdd6424 for instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 on user Apr 19 08:08:31 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-bf3a845b-616a-4c3e-82c7-f10f71317337 req-62587458-656c-4665-9db9-0cdc896e8fac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030659 Apr 19 08:08:31 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 107/315] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:08:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:08:31 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-63ad0220-b4c7-4538-aa99-66d9608fb9db tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2027c586717a407baa7cd8f3cdc56459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f98320d1745918cc7e2ca0ddf0ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:08:31 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-63ad0220-b4c7-4538-aa99-66d9608fb9db tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/60cdd0c0-d5ec-4744-932e-61cb5c48d457" status: 200 len: 1500 microversion: 2.1 time: 0.281648 Apr 19 08:08:31 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 106/316] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:08:30 2023] GET /compute/v2.1/servers/60cdd0c0-d5ec-4744-932e-61cb5c48d457 => generated 1500 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:08:32 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-903dc5b4-c646-404c-b262-167a1d271173 req-cc0b8ca0-d9e5-4197-bebd-29d0b6e0a477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60cdd0c0-d5ec-4744-932e-61cb5c48d457", "name": "network-vif-deleted", "tag": "8648e8f8-b9bc-41e0-819b-68f3bcdd6424"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:08:32 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-903dc5b4-c646-404c-b262-167a1d271173 req-cc0b8ca0-d9e5-4197-bebd-29d0b6e0a477 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:08:32 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-903dc5b4-c646-404c-b262-167a1d271173 req-cc0b8ca0-d9e5-4197-bebd-29d0b6e0a477 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:08:32 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-903dc5b4-c646-404c-b262-167a1d271173 req-cc0b8ca0-d9e5-4197-bebd-29d0b6e0a477 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:08:32 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-903dc5b4-c646-404c-b262-167a1d271173 req-cc0b8ca0-d9e5-4197-bebd-29d0b6e0a477 service nova] Creating event network-vif-deleted:8648e8f8-b9bc-41e0-819b-68f3bcdd6424 for instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 on user Apr 19 08:08:32 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-903dc5b4-c646-404c-b262-167a1d271173 req-cc0b8ca0-d9e5-4197-bebd-29d0b6e0a477 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035417 Apr 19 08:08:32 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 104/317] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:08:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:08:33 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-b008d399-9148-405b-ae55-db64680ba4a2 req-b0f90984-5dfc-4487-8d5a-7554ec3f426d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60cdd0c0-d5ec-4744-932e-61cb5c48d457", "name": "network-vif-plugged", "status": "completed", "tag": "8648e8f8-b9bc-41e0-819b-68f3bcdd6424"}, {"server_uuid": "60cdd0c0-d5ec-4744-932e-61cb5c48d457", "name": "network-vif-plugged", "status": "completed", "tag": "8648e8f8-b9bc-41e0-819b-68f3bcdd6424"}, {"server_uuid": "60cdd0c0-d5ec-4744-932e-61cb5c48d457", "name": "network-vif-plugged", "status": "completed", "tag": "8648e8f8-b9bc-41e0-819b-68f3bcdd6424"}, {"server_uuid": "60cdd0c0-d5ec-4744-932e-61cb5c48d457", "name": "network-vif-unplugged", "status": "completed", "tag": "8648e8f8-b9bc-41e0-819b-68f3bcdd6424"}, {"server_uuid": "60cdd0c0-d5ec-4744-932e-61cb5c48d457", "name": "network-vif-plugged", "status": "completed", "tag": "8648e8f8-b9bc-41e0-819b-68f3bcdd6424"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:08:33 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-b008d399-9148-405b-ae55-db64680ba4a2 req-b0f90984-5dfc-4487-8d5a-7554ec3f426d service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:08:33 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-b008d399-9148-405b-ae55-db64680ba4a2 req-b0f90984-5dfc-4487-8d5a-7554ec3f426d service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:08:33 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-b008d399-9148-405b-ae55-db64680ba4a2 req-b0f90984-5dfc-4487-8d5a-7554ec3f426d service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:08:33 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-b008d399-9148-405b-ae55-db64680ba4a2 req-b0f90984-5dfc-4487-8d5a-7554ec3f426d service nova] Creating event network-vif-plugged:8648e8f8-b9bc-41e0-819b-68f3bcdd6424 for instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 on user Apr 19 08:08:33 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-b008d399-9148-405b-ae55-db64680ba4a2 req-b0f90984-5dfc-4487-8d5a-7554ec3f426d service nova] Creating event network-vif-plugged:8648e8f8-b9bc-41e0-819b-68f3bcdd6424 for instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 on user Apr 19 08:08:33 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-b008d399-9148-405b-ae55-db64680ba4a2 req-b0f90984-5dfc-4487-8d5a-7554ec3f426d service nova] Creating event network-vif-plugged:8648e8f8-b9bc-41e0-819b-68f3bcdd6424 for instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 on user Apr 19 08:08:33 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-b008d399-9148-405b-ae55-db64680ba4a2 req-b0f90984-5dfc-4487-8d5a-7554ec3f426d service nova] Creating event network-vif-unplugged:8648e8f8-b9bc-41e0-819b-68f3bcdd6424 for instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 on user Apr 19 08:08:33 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-b008d399-9148-405b-ae55-db64680ba4a2 req-b0f90984-5dfc-4487-8d5a-7554ec3f426d service nova] Creating event network-vif-plugged:8648e8f8-b9bc-41e0-819b-68f3bcdd6424 for instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 on user Apr 19 08:08:33 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-b008d399-9148-405b-ae55-db64680ba4a2 req-b0f90984-5dfc-4487-8d5a-7554ec3f426d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.032458 Apr 19 08:08:33 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 108/318] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:08:33 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:08:35 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-464095fa-7f1f-4960-a257-aaad1449f6bd tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:08:35 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-464095fa-7f1f-4960-a257-aaad1449f6bd tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] [instance: bdeeb437-76a3-49b5-9553-d2da74917d69] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:08:35 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-464095fa-7f1f-4960-a257-aaad1449f6bd tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:08:35 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-464095fa-7f1f-4960-a257-aaad1449f6bd tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:08:35 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-464095fa-7f1f-4960-a257-aaad1449f6bd tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:08:35 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-464095fa-7f1f-4960-a257-aaad1449f6bd tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:08:35 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-464095fa-7f1f-4960-a257-aaad1449f6bd tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:08:35 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-464095fa-7f1f-4960-a257-aaad1449f6bd tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:08:36 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-464095fa-7f1f-4960-a257-aaad1449f6bd tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dc2a88f2d149a1a4035ed1c7e74b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcde8c2a3444e919d232ea854c00e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:08:36 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-464095fa-7f1f-4960-a257-aaad1449f6bd tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69" status: 200 len: 1658 microversion: 2.1 time: 0.305300 Apr 19 08:08:36 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 107/319] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:08:35 2023] GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69 => generated 1658 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:08:59 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:08:59 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:08:59 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-d6cbbf5a-b2cf-41aa-8aa3-f8f611438aa1 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1605275303", "imageRef": "b515545f-3b22-4d80-a102-6a318ab9717a", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "c200dc82-8f76-41a5-8f0d-25b3fdcf2132"}]}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:08:59 user devstack@n-api.service[61209]: DEBUG nova.network.neutron [None req-d6cbbf5a-b2cf-41aa-8aa3-f8f611438aa1 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] validate_networks() for [('c200dc82-8f76-41a5-8f0d-25b3fdcf2132', None, None, None, None, None)] {{(pid=61209) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 08:08:59 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-d6cbbf5a-b2cf-41aa-8aa3-f8f611438aa1 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Flavor limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 08:08:59 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-d6cbbf5a-b2cf-41aa-8aa3-f8f611438aa1 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Image limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 08:08:59 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-d6cbbf5a-b2cf-41aa-8aa3-f8f611438aa1 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Flavor pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 08:08:59 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-d6cbbf5a-b2cf-41aa-8aa3-f8f611438aa1 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Image pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 08:08:59 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-d6cbbf5a-b2cf-41aa-8aa3-f8f611438aa1 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 08:08:59 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d6cbbf5a-b2cf-41aa-8aa3-f8f611438aa1 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:08:59 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d6cbbf5a-b2cf-41aa-8aa3-f8f611438aa1 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:08:59 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d6cbbf5a-b2cf-41aa-8aa3-f8f611438aa1 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:08:59 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d6cbbf5a-b2cf-41aa-8aa3-f8f611438aa1 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:08:59 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d6cbbf5a-b2cf-41aa-8aa3-f8f611438aa1 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:08:59 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d6cbbf5a-b2cf-41aa-8aa3-f8f611438aa1 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:08:59 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-d6cbbf5a-b2cf-41aa-8aa3-f8f611438aa1 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Getting quotas for project 7973fa0075de42e9a74627ae9cd98d9f. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:08:59 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-d6cbbf5a-b2cf-41aa-8aa3-f8f611438aa1 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Getting quotas for user 5530f99504de4426ba41cfa691c430c0 and project 7973fa0075de42e9a74627ae9cd98d9f. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:08:59 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-d6cbbf5a-b2cf-41aa-8aa3-f8f611438aa1 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Going to run 1 instances... {{(pid=61209) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 08:08:59 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-d6cbbf5a-b2cf-41aa-8aa3-f8f611438aa1 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 823c04fd-d328-4013-ac57-d5c32255c8b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 08:08:59 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-d6cbbf5a-b2cf-41aa-8aa3-f8f611438aa1 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.617180 Apr 19 08:08:59 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 105/320] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 08:08:59 2023] POST /compute/v2.1/servers => generated 378 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 08:08:59 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=10 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:08:59 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=12 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:08:59 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-86c82e2a-f449-4c54-8819-2388a6b9884e tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:08:59 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-86c82e2a-f449-4c54-8819-2388a6b9884e tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 823c04fd-d328-4013-ac57-d5c32255c8b1] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:08:59 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-86c82e2a-f449-4c54-8819-2388a6b9884e tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:08:59 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-86c82e2a-f449-4c54-8819-2388a6b9884e tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:08:59 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-86c82e2a-f449-4c54-8819-2388a6b9884e tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:08:59 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-86c82e2a-f449-4c54-8819-2388a6b9884e tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/823c04fd-d328-4013-ac57-d5c32255c8b1" status: 200 len: 1395 microversion: 2.87 time: 0.072773 Apr 19 08:08:59 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 109/321] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:08:59 2023] GET /compute/v2.1/servers/823c04fd-d328-4013-ac57-d5c32255c8b1 => generated 1395 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 08:09:01 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-6c7a65ca-7ab8-4b83-a949-e6c0d2b18277 req-1d7f460f-3914-474d-96e4-99b4ca22cc05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "823c04fd-d328-4013-ac57-d5c32255c8b1", "tag": "67d4c99d-af94-4134-a3c2-ee3be6e7b69d"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:09:01 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:01 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:01 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-6c7a65ca-7ab8-4b83-a949-e6c0d2b18277 req-1d7f460f-3914-474d-96e4-99b4ca22cc05 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:01 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-6c7a65ca-7ab8-4b83-a949-e6c0d2b18277 req-1d7f460f-3914-474d-96e4-99b4ca22cc05 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:01 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-6c7a65ca-7ab8-4b83-a949-e6c0d2b18277 req-1d7f460f-3914-474d-96e4-99b4ca22cc05 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:01 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-6c7a65ca-7ab8-4b83-a949-e6c0d2b18277 req-1d7f460f-3914-474d-96e4-99b4ca22cc05 service nova] Creating event network-changed:67d4c99d-af94-4134-a3c2-ee3be6e7b69d for instance 823c04fd-d328-4013-ac57-d5c32255c8b1 on user Apr 19 08:09:01 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-6c7a65ca-7ab8-4b83-a949-e6c0d2b18277 req-1d7f460f-3914-474d-96e4-99b4ca22cc05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047103 Apr 19 08:09:01 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 108/322] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:09:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 08:09:03 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-e99f0412-3f5a-40fa-aec3-63283ee2bbd6 req-0ca18cf5-154c-435b-a7f5-08c5458de066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "823c04fd-d328-4013-ac57-d5c32255c8b1", "name": "network-vif-deleted", "tag": "67d4c99d-af94-4134-a3c2-ee3be6e7b69d"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:09:03 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-e99f0412-3f5a-40fa-aec3-63283ee2bbd6 req-0ca18cf5-154c-435b-a7f5-08c5458de066 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:03 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-e99f0412-3f5a-40fa-aec3-63283ee2bbd6 req-0ca18cf5-154c-435b-a7f5-08c5458de066 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:03 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-e99f0412-3f5a-40fa-aec3-63283ee2bbd6 req-0ca18cf5-154c-435b-a7f5-08c5458de066 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:03 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.compute.server_external_events [req-e99f0412-3f5a-40fa-aec3-63283ee2bbd6 req-0ca18cf5-154c-435b-a7f5-08c5458de066 service nova] Unable to find a host for instance 823c04fd-d328-4013-ac57-d5c32255c8b1. Dropping event network-vif-deleted {{(pid=61209) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 19 08:09:03 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-e99f0412-3f5a-40fa-aec3-63283ee2bbd6 req-0ca18cf5-154c-435b-a7f5-08c5458de066 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.024491 Apr 19 08:09:03 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 106/323] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:09:03 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 19 08:09:14 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-464fa788-a044-4111-bde1-afa6309abd52 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:09:14 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-464fa788-a044-4111-bde1-afa6309abd52 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] [instance: 45c79c22-b7be-444f-8d5a-f152377c70f3] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:09:14 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell0:SELECT=2 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:14 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=6 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:14 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-464fa788-a044-4111-bde1-afa6309abd52 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:14 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-464fa788-a044-4111-bde1-afa6309abd52 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:14 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-464fa788-a044-4111-bde1-afa6309abd52 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:14 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-464fa788-a044-4111-bde1-afa6309abd52 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:14 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-464fa788-a044-4111-bde1-afa6309abd52 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:14 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-464fa788-a044-4111-bde1-afa6309abd52 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:14 user devstack@n-api.service[61210]: INFO nova.api.openstack.wsgi [None req-464fa788-a044-4111-bde1-afa6309abd52 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] HTTP exception thrown: Instance 45c79c22-b7be-444f-8d5a-f152377c70f3 could not be found. Apr 19 08:09:14 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-464fa788-a044-4111-bde1-afa6309abd52 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Request method failure captured: Apr 19 08:09:14 user devstack@n-api.service[61210]: request: GET /compute/v2.1/servers/45c79c22-b7be-444f-8d5a-f152377c70f3 HTTP/1.1 Apr 19 08:09:14 user devstack@n-api.service[61210]: Accept: application/json Apr 19 08:09:14 user devstack@n-api.service[61210]: Accept-Encoding: identity Apr 19 08:09:14 user devstack@n-api.service[61210]: Connection: close Apr 19 08:09:14 user devstack@n-api.service[61210]: Content-Length: 0 Apr 19 08:09:14 user devstack@n-api.service[61210]: Content-Type: application/json Apr 19 08:09:14 user devstack@n-api.service[61210]: Host: 10.0.0.210 Apr 19 08:09:14 user devstack@n-api.service[61210]: Openstack-System-Scope: None Apr 19 08:09:14 user devstack@n-api.service[61210]: User-Agent: python-urllib3/1.26.15 Apr 19 08:09:14 user devstack@n-api.service[61210]: X-Auth-Token: gAAAAABkP6EEy1tc3_nQGep4bEpMFqh5uA59YicJp0vv0TPYgBhmcE3rIw02B_W-J3gKcT0_ijrOgU0QhTzYvN24TTP91Em23hZn7bKet4PXoX6Rq6iur5mfEGZtIE5FNz1wI2LGa8agXuosZRbbJi6Cda0ne5t9hwW-pubpM70Eiac8UkNw0nM Apr 19 08:09:14 user devstack@n-api.service[61210]: X-Domain-Id: None Apr 19 08:09:14 user devstack@n-api.service[61210]: X-Domain-Name: None Apr 19 08:09:14 user devstack@n-api.service[61210]: X-Identity-Status: Confirmed Apr 19 08:09:14 user devstack@n-api.service[61210]: X-Is-Admin-Project: True Apr 19 08:09:14 user devstack@n-api.service[61210]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 08:09:14 user devstack@n-api.service[61210]: X-Project-Domain-Id: default Apr 19 08:09:14 user devstack@n-api.service[61210]: X-Project-Domain-Name: Default Apr 19 08:09:14 user devstack@n-api.service[61210]: X-Project-Id: f475ef63d11f4decbd33dfc63e108d12 Apr 19 08:09:14 user devstack@n-api.service[61210]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-459720759 Apr 19 08:09:14 user devstack@n-api.service[61210]: X-Role: reader,member Apr 19 08:09:14 user devstack@n-api.service[61210]: X-Roles: reader,member Apr 19 08:09:14 user devstack@n-api.service[61210]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f475ef63d11f4decbd33dfc63e108d12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f475ef63d11f4decbd33dfc63e108d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f475ef63d11f4decbd33dfc63e108d12"}]}] Apr 19 08:09:14 user devstack@n-api.service[61210]: X-Tenant: tempest-AttachVolumeShelveTestJSON-459720759 Apr 19 08:09:14 user devstack@n-api.service[61210]: X-Tenant-Id: f475ef63d11f4decbd33dfc63e108d12 Apr 19 08:09:14 user devstack@n-api.service[61210]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-459720759 Apr 19 08:09:14 user devstack@n-api.service[61210]: X-User: tempest-AttachVolumeShelveTestJSON-459720759-project-member Apr 19 08:09:14 user devstack@n-api.service[61210]: X-User-Domain-Id: default Apr 19 08:09:14 user devstack@n-api.service[61210]: X-User-Domain-Name: Default Apr 19 08:09:14 user devstack@n-api.service[61210]: X-User-Id: a0d79080dd7b4e20932eb3774bdc97a4 Apr 19 08:09:14 user devstack@n-api.service[61210]: X-User-Name: tempest-AttachVolumeShelveTestJSON-459720759-project-member Apr 19 08:09:14 user devstack@n-api.service[61210]: method: > Apr 19 08:09:14 user devstack@n-api.service[61210]: exception: Instance 45c79c22-b7be-444f-8d5a-f152377c70f3 could not be found. Apr 19 08:09:14 user devstack@n-api.service[61210]: action_args: {'id': '45c79c22-b7be-444f-8d5a-f152377c70f3'} Apr 19 08:09:14 user devstack@n-api.service[61210]: {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45c79c22-b7be-444f-8d5a-f152377c70f3 could not be found. Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45c79c22-b7be-444f-8d5a-f152377c70f3 could not be found. Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45c79c22-b7be-444f-8d5a-f152377c70f3 could not be found. Apr 19 08:09:14 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:09:14 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-464fa788-a044-4111-bde1-afa6309abd52 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Returning 404 to user: Instance 45c79c22-b7be-444f-8d5a-f152377c70f3 could not be found. {{(pid=61210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:09:14 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-464fa788-a044-4111-bde1-afa6309abd52 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/45c79c22-b7be-444f-8d5a-f152377c70f3" status: 404 len: 111 microversion: 2.20 time: 0.032383 Apr 19 08:09:14 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 110/324] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:09:14 2023] GET /compute/v2.1/servers/45c79c22-b7be-444f-8d5a-f152377c70f3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 08:09:14 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:14 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:14 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-6582bcc2-132f-4eb0-9623-f1038d3fdd2f tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Calling method '.version_select at 0x7f2c00f4ff40>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:09:14 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-6582bcc2-132f-4eb0-9623-f1038d3fdd2f tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-337992567" status: 204 len: 0 microversion: 2.20 time: 0.024550 Apr 19 08:09:14 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 109/325] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 19 08:09:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-337992567 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 08:09:15 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:15 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=6 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:15 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:15 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=4 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:15 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-d7c48961-0959-4e9d-b7ca-97dbfefe8fd5 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Action: 'create', calling method: .version_select at 0x7f2c010ccb80>, body: {"keypair": {"name": "tempest-keypair-810739864", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhlzmqfWJSsH1F+DcjSKjHN4sZ1KDyWRfvmQ1yol5vD5IewJca0DPaFYXLL4zponYyVw45uvTfI2IuifcM/ZeUHHy1nlW27yCZX4ED6bq6Ew1gCUchsEqlXQL00DNcsNQ=="}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:09:15 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-d7c48961-0959-4e9d-b7ca-97dbfefe8fd5 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Getting quotas for project f475ef63d11f4decbd33dfc63e108d12. Resources: {'key_pairs'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:09:15 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-d7c48961-0959-4e9d-b7ca-97dbfefe8fd5 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Getting quotas for user a0d79080dd7b4e20932eb3774bdc97a4 and project f475ef63d11f4decbd33dfc63e108d12. Resources: {'key_pairs'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:09:15 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-d7c48961-0959-4e9d-b7ca-97dbfefe8fd5 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.054444 Apr 19 08:09:15 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 107/326] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 19 08:09:15 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 19 08:09:17 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-d7bc3d6a-c217-4d40-9140-562de1b82dbb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1199096627", "imageRef": "b515545f-3b22-4d80-a102-6a318ab9717a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "148f1dce-55c7-456b-971d-00cad5c4c568"}], "security_groups": [{"name": "tempest-securitygroup--910100136"}], "key_name": "tempest-keypair-810739864", "user_data": "}} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:09:17 user devstack@n-api.service[61210]: DEBUG nova.network.neutron [None req-d7bc3d6a-c217-4d40-9140-562de1b82dbb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] validate_networks() for [('148f1dce-55c7-456b-971d-00cad5c4c568', None, None, None, None, None)] {{(pid=61210) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 08:09:17 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-d7bc3d6a-c217-4d40-9140-562de1b82dbb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Flavor limits 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 08:09:17 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-d7bc3d6a-c217-4d40-9140-562de1b82dbb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Image limits 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 08:09:17 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-d7bc3d6a-c217-4d40-9140-562de1b82dbb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Flavor pref 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 08:09:17 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-d7bc3d6a-c217-4d40-9140-562de1b82dbb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Image pref 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 08:09:17 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-d7bc3d6a-c217-4d40-9140-562de1b82dbb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 08:09:17 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-d7bc3d6a-c217-4d40-9140-562de1b82dbb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:17 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-d7bc3d6a-c217-4d40-9140-562de1b82dbb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:17 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-d7bc3d6a-c217-4d40-9140-562de1b82dbb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:17 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-d7bc3d6a-c217-4d40-9140-562de1b82dbb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:17 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-d7bc3d6a-c217-4d40-9140-562de1b82dbb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:17 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-d7bc3d6a-c217-4d40-9140-562de1b82dbb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:17 user devstack@n-api.service[61210]: DEBUG nova.quota [None req-d7bc3d6a-c217-4d40-9140-562de1b82dbb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Getting quotas for project f475ef63d11f4decbd33dfc63e108d12. Resources: {'ram', 'cores', 'instances'} {{(pid=61210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:09:17 user devstack@n-api.service[61210]: DEBUG nova.quota [None req-d7bc3d6a-c217-4d40-9140-562de1b82dbb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Getting quotas for user a0d79080dd7b4e20932eb3774bdc97a4 and project f475ef63d11f4decbd33dfc63e108d12. Resources: {'ram', 'cores', 'instances'} {{(pid=61210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:09:17 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-d7bc3d6a-c217-4d40-9140-562de1b82dbb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Going to run 1 instances... {{(pid=61210) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 08:09:17 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-d7bc3d6a-c217-4d40-9140-562de1b82dbb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] [instance: 7be61ae3-a9cd-4a68-8494-395f685ff6ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b515545f-3b22-4d80-a102-6a318ab9717a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 08:09:17 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-d7bc3d6a-c217-4d40-9140-562de1b82dbb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.617111 Apr 19 08:09:17 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 111/327] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 08:09:17 2023] POST /compute/v2.1/servers => generated 399 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 08:09:17 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-1986127c-c7a7-4087-addf-9b95a6fa5534 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:09:17 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-1986127c-c7a7-4087-addf-9b95a6fa5534 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] [instance: 7be61ae3-a9cd-4a68-8494-395f685ff6ee] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:09:17 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-1986127c-c7a7-4087-addf-9b95a6fa5534 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d79080dd7b4e20932eb3774bdc97a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f475ef63d11f4decbd33dfc63e108d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:09:17 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-1986127c-c7a7-4087-addf-9b95a6fa5534 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0d79080dd7b4e20932eb3774bdc97a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f475ef63d11f4decbd33dfc63e108d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:09:17 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-1986127c-c7a7-4087-addf-9b95a6fa5534 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0d79080dd7b4e20932eb3774bdc97a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f475ef63d11f4decbd33dfc63e108d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:09:17 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-1986127c-c7a7-4087-addf-9b95a6fa5534 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7be61ae3-a9cd-4a68-8494-395f685ff6ee" status: 200 len: 1275 microversion: 2.20 time: 0.067091 Apr 19 08:09:17 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 110/328] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:09:17 2023] GET /compute/v2.1/servers/7be61ae3-a9cd-4a68-8494-395f685ff6ee => generated 1275 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 08:09:20 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-72b8db74-0d8e-4306-af57-7198e49fa481 req-ab6f179f-cf63-4956-96db-36be6aaab5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7be61ae3-a9cd-4a68-8494-395f685ff6ee", "tag": "3f2753b2-3728-4d4a-8238-f08e4d03e465"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:09:20 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-72b8db74-0d8e-4306-af57-7198e49fa481 req-ab6f179f-cf63-4956-96db-36be6aaab5d3 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:20 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-72b8db74-0d8e-4306-af57-7198e49fa481 req-ab6f179f-cf63-4956-96db-36be6aaab5d3 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:20 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-72b8db74-0d8e-4306-af57-7198e49fa481 req-ab6f179f-cf63-4956-96db-36be6aaab5d3 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:20 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-72b8db74-0d8e-4306-af57-7198e49fa481 req-ab6f179f-cf63-4956-96db-36be6aaab5d3 service nova] Creating event network-changed:3f2753b2-3728-4d4a-8238-f08e4d03e465 for instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee on user Apr 19 08:09:20 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-72b8db74-0d8e-4306-af57-7198e49fa481 req-ab6f179f-cf63-4956-96db-36be6aaab5d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031026 Apr 19 08:09:20 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 108/329] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:09:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:09:21 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-18b58b02-99ef-40b1-b7da-db99a9db947e tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:09:21 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-18b58b02-99ef-40b1-b7da-db99a9db947e tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] [instance: 60cdd0c0-d5ec-4744-932e-61cb5c48d457] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:09:21 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-18b58b02-99ef-40b1-b7da-db99a9db947e tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:21 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-18b58b02-99ef-40b1-b7da-db99a9db947e tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:21 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-18b58b02-99ef-40b1-b7da-db99a9db947e tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:21 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-18b58b02-99ef-40b1-b7da-db99a9db947e tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:21 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-18b58b02-99ef-40b1-b7da-db99a9db947e tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:21 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-18b58b02-99ef-40b1-b7da-db99a9db947e tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:21 user devstack@n-api.service[61210]: INFO nova.api.openstack.wsgi [None req-18b58b02-99ef-40b1-b7da-db99a9db947e tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] HTTP exception thrown: Instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 could not be found. Apr 19 08:09:21 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-18b58b02-99ef-40b1-b7da-db99a9db947e tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Request method failure captured: Apr 19 08:09:21 user devstack@n-api.service[61210]: request: GET /compute/v2.1/servers/60cdd0c0-d5ec-4744-932e-61cb5c48d457 HTTP/1.1 Apr 19 08:09:21 user devstack@n-api.service[61210]: Accept: application/json Apr 19 08:09:21 user devstack@n-api.service[61210]: Accept-Encoding: identity Apr 19 08:09:21 user devstack@n-api.service[61210]: Connection: close Apr 19 08:09:21 user devstack@n-api.service[61210]: Content-Length: 0 Apr 19 08:09:21 user devstack@n-api.service[61210]: Content-Type: application/json Apr 19 08:09:21 user devstack@n-api.service[61210]: Host: 10.0.0.210 Apr 19 08:09:21 user devstack@n-api.service[61210]: Openstack-System-Scope: None Apr 19 08:09:21 user devstack@n-api.service[61210]: User-Agent: python-urllib3/1.26.15 Apr 19 08:09:21 user devstack@n-api.service[61210]: X-Auth-Token: gAAAAABkP6CgJxHidkjfoI--LDc5KvPpxSL89iY0OQsgPWUWUwFCVTzN7vYbsmYbjqcr3a4kcC_FKoqqnWkAlNd7891u-NNsLCYF3a-1uzY8KvyIhFlN2QzUrMw9qIQ2ybW8b4PmlQfATGblc4It1EJEC8lsRNjxADFPe0BXOMqv3GlfwuvJ6XY Apr 19 08:09:21 user devstack@n-api.service[61210]: X-Domain-Id: None Apr 19 08:09:21 user devstack@n-api.service[61210]: X-Domain-Name: None Apr 19 08:09:21 user devstack@n-api.service[61210]: X-Identity-Status: Confirmed Apr 19 08:09:21 user devstack@n-api.service[61210]: X-Is-Admin-Project: True Apr 19 08:09:21 user devstack@n-api.service[61210]: X-Project-Domain-Id: default Apr 19 08:09:21 user devstack@n-api.service[61210]: X-Project-Domain-Name: Default Apr 19 08:09:21 user devstack@n-api.service[61210]: X-Project-Id: 789f98320d1745918cc7e2ca0ddf0ca8 Apr 19 08:09:21 user devstack@n-api.service[61210]: X-Project-Name: tempest-ServersNegativeTestJSON-1657975515 Apr 19 08:09:21 user devstack@n-api.service[61210]: X-Role: reader,member Apr 19 08:09:21 user devstack@n-api.service[61210]: X-Roles: reader,member Apr 19 08:09:21 user devstack@n-api.service[61210]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/789f98320d1745918cc7e2ca0ddf0ca8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/789f98320d1745918cc7e2ca0ddf0ca8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/789f98320d1745918cc7e2ca0ddf0ca8"}]}] Apr 19 08:09:21 user devstack@n-api.service[61210]: X-Tenant: tempest-ServersNegativeTestJSON-1657975515 Apr 19 08:09:21 user devstack@n-api.service[61210]: X-Tenant-Id: 789f98320d1745918cc7e2ca0ddf0ca8 Apr 19 08:09:21 user devstack@n-api.service[61210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657975515 Apr 19 08:09:21 user devstack@n-api.service[61210]: X-User: tempest-ServersNegativeTestJSON-1657975515-project-member Apr 19 08:09:21 user devstack@n-api.service[61210]: X-User-Domain-Id: default Apr 19 08:09:21 user devstack@n-api.service[61210]: X-User-Domain-Name: Default Apr 19 08:09:21 user devstack@n-api.service[61210]: X-User-Id: 2027c586717a407baa7cd8f3cdc56459 Apr 19 08:09:21 user devstack@n-api.service[61210]: X-User-Name: tempest-ServersNegativeTestJSON-1657975515-project-member Apr 19 08:09:21 user devstack@n-api.service[61210]: method: > Apr 19 08:09:21 user devstack@n-api.service[61210]: exception: Instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 could not be found. Apr 19 08:09:21 user devstack@n-api.service[61210]: action_args: {'id': '60cdd0c0-d5ec-4744-932e-61cb5c48d457'} Apr 19 08:09:21 user devstack@n-api.service[61210]: {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 could not be found. Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 could not be found. Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 could not be found. Apr 19 08:09:21 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:09:21 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-18b58b02-99ef-40b1-b7da-db99a9db947e tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Returning 404 to user: Instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 could not be found. {{(pid=61210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:09:21 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-18b58b02-99ef-40b1-b7da-db99a9db947e tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/60cdd0c0-d5ec-4744-932e-61cb5c48d457" status: 404 len: 111 microversion: 2.1 time: 0.027917 Apr 19 08:09:21 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 112/330] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:09:21 2023] GET /compute/v2.1/servers/60cdd0c0-d5ec-4744-932e-61cb5c48d457 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:09:21 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-68bb85f7-7b05-4fb4-bba2-edbd533626e0 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:09:21 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-68bb85f7-7b05-4fb4-bba2-edbd533626e0 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] [instance: 266d27ff-db1d-443a-8562-b67a859afe20] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:09:21 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-68bb85f7-7b05-4fb4-bba2-edbd533626e0 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:21 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-68bb85f7-7b05-4fb4-bba2-edbd533626e0 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:21 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-68bb85f7-7b05-4fb4-bba2-edbd533626e0 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:21 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-68bb85f7-7b05-4fb4-bba2-edbd533626e0 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:21 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-68bb85f7-7b05-4fb4-bba2-edbd533626e0 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:21 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-68bb85f7-7b05-4fb4-bba2-edbd533626e0 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:21 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-68bb85f7-7b05-4fb4-bba2-edbd533626e0 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2027c586717a407baa7cd8f3cdc56459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f98320d1745918cc7e2ca0ddf0ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:09:21 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-68bb85f7-7b05-4fb4-bba2-edbd533626e0 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/266d27ff-db1d-443a-8562-b67a859afe20" status: 200 len: 1493 microversion: 2.1 time: 0.217359 Apr 19 08:09:21 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 111/331] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:09:21 2023] GET /compute/v2.1/servers/266d27ff-db1d-443a-8562-b67a859afe20 => generated 1493 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:09:22 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-c9472659-7065-4ed3-9d8e-ab5c6f319fda req-c34b8204-0142-46a7-a7d0-59ba89ac8f8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be61ae3-a9cd-4a68-8494-395f685ff6ee", "name": "network-vif-plugged", "status": "completed", "tag": "3f2753b2-3728-4d4a-8238-f08e4d03e465"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:09:22 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-c9472659-7065-4ed3-9d8e-ab5c6f319fda req-c34b8204-0142-46a7-a7d0-59ba89ac8f8f service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:22 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-c9472659-7065-4ed3-9d8e-ab5c6f319fda req-c34b8204-0142-46a7-a7d0-59ba89ac8f8f service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:22 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-c9472659-7065-4ed3-9d8e-ab5c6f319fda req-c34b8204-0142-46a7-a7d0-59ba89ac8f8f service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:22 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-c9472659-7065-4ed3-9d8e-ab5c6f319fda req-c34b8204-0142-46a7-a7d0-59ba89ac8f8f service nova] Creating event network-vif-plugged:3f2753b2-3728-4d4a-8238-f08e4d03e465 for instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee on user Apr 19 08:09:22 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-c9472659-7065-4ed3-9d8e-ab5c6f319fda req-c34b8204-0142-46a7-a7d0-59ba89ac8f8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033779 Apr 19 08:09:22 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 109/332] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:09:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:09:24 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-52329a4d-780a-45f4-8906-f914bd17e0d9 req-1e88e293-3792-471f-83e1-869541c756da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be61ae3-a9cd-4a68-8494-395f685ff6ee", "name": "network-vif-plugged", "status": "completed", "tag": "3f2753b2-3728-4d4a-8238-f08e4d03e465"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:09:24 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-52329a4d-780a-45f4-8906-f914bd17e0d9 req-1e88e293-3792-471f-83e1-869541c756da service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:24 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-52329a4d-780a-45f4-8906-f914bd17e0d9 req-1e88e293-3792-471f-83e1-869541c756da service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:24 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-52329a4d-780a-45f4-8906-f914bd17e0d9 req-1e88e293-3792-471f-83e1-869541c756da service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:24 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-52329a4d-780a-45f4-8906-f914bd17e0d9 req-1e88e293-3792-471f-83e1-869541c756da service nova] Creating event network-vif-plugged:3f2753b2-3728-4d4a-8238-f08e4d03e465 for instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee on user Apr 19 08:09:24 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-52329a4d-780a-45f4-8906-f914bd17e0d9 req-1e88e293-3792-471f-83e1-869541c756da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028570 Apr 19 08:09:24 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 113/333] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:09:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:09:36 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-903c6381-6fb5-449e-abba-752856ec4e5c tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:09:36 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-903c6381-6fb5-449e-abba-752856ec4e5c tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] [instance: bdeeb437-76a3-49b5-9553-d2da74917d69] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:09:36 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:36 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:36 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=6 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:36 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-903c6381-6fb5-449e-abba-752856ec4e5c tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:36 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-903c6381-6fb5-449e-abba-752856ec4e5c tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:36 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-903c6381-6fb5-449e-abba-752856ec4e5c tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:36 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-903c6381-6fb5-449e-abba-752856ec4e5c tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:36 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-903c6381-6fb5-449e-abba-752856ec4e5c tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:36 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-903c6381-6fb5-449e-abba-752856ec4e5c tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:36 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-903c6381-6fb5-449e-abba-752856ec4e5c tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] [instance: bdeeb437-76a3-49b5-9553-d2da74917d69] Going to try to terminate instance {{(pid=61208) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:09:36 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-903c6381-6fb5-449e-abba-752856ec4e5c tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69" status: 204 len: 0 microversion: 2.1 time: 0.122673 Apr 19 08:09:36 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 112/334] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:09:36 2023] DELETE /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 08:09:36 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-a69c53a1-fa42-4822-adea-d7b2eff666d6 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:09:36 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-a69c53a1-fa42-4822-adea-d7b2eff666d6 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] [instance: bdeeb437-76a3-49b5-9553-d2da74917d69] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:09:36 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=4 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:36 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:36 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=4 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:36 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-a69c53a1-fa42-4822-adea-d7b2eff666d6 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:36 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-a69c53a1-fa42-4822-adea-d7b2eff666d6 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:36 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-a69c53a1-fa42-4822-adea-d7b2eff666d6 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:36 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-a69c53a1-fa42-4822-adea-d7b2eff666d6 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:36 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-a69c53a1-fa42-4822-adea-d7b2eff666d6 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:36 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-a69c53a1-fa42-4822-adea-d7b2eff666d6 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:36 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-a9fae4f5-23df-4462-9f22-4af9f76bc8b7 req-f88d0540-1c53-4f65-972b-c7b186be5ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdeeb437-76a3-49b5-9553-d2da74917d69", "name": "network-vif-unplugged", "status": "completed", "tag": "8cebef39-d819-436e-9047-40d02c752d9e"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:09:36 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell0:SELECT=2 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:36 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell0:SELECT=6 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:36 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:36 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=8 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:36 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-a9fae4f5-23df-4462-9f22-4af9f76bc8b7 req-f88d0540-1c53-4f65-972b-c7b186be5ae5 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:36 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-a9fae4f5-23df-4462-9f22-4af9f76bc8b7 req-f88d0540-1c53-4f65-972b-c7b186be5ae5 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:36 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-a9fae4f5-23df-4462-9f22-4af9f76bc8b7 req-f88d0540-1c53-4f65-972b-c7b186be5ae5 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:36 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-a9fae4f5-23df-4462-9f22-4af9f76bc8b7 req-f88d0540-1c53-4f65-972b-c7b186be5ae5 service nova] Creating event network-vif-unplugged:8cebef39-d819-436e-9047-40d02c752d9e for instance bdeeb437-76a3-49b5-9553-d2da74917d69 on user Apr 19 08:09:36 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-a9fae4f5-23df-4462-9f22-4af9f76bc8b7 req-f88d0540-1c53-4f65-972b-c7b186be5ae5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038872 Apr 19 08:09:36 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 114/335] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:09:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:09:37 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-a69c53a1-fa42-4822-adea-d7b2eff666d6 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16dc2a88f2d149a1a4035ed1c7e74b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcde8c2a3444e919d232ea854c00e6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:09:37 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-a69c53a1-fa42-4822-adea-d7b2eff666d6 tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69" status: 200 len: 1664 microversion: 2.1 time: 0.461750 Apr 19 08:09:37 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 110/336] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:09:36 2023] GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69 => generated 1664 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:09:38 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-0cc1d240-485b-4be7-ab82-c35437335431 req-e1926021-8c02-46fb-9f07-c3a9157867c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdeeb437-76a3-49b5-9553-d2da74917d69", "name": "network-vif-deleted", "tag": "8cebef39-d819-436e-9047-40d02c752d9e"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:09:38 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-0cc1d240-485b-4be7-ab82-c35437335431 req-e1926021-8c02-46fb-9f07-c3a9157867c0 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:38 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-0cc1d240-485b-4be7-ab82-c35437335431 req-e1926021-8c02-46fb-9f07-c3a9157867c0 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:38 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-0cc1d240-485b-4be7-ab82-c35437335431 req-e1926021-8c02-46fb-9f07-c3a9157867c0 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:38 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-0cc1d240-485b-4be7-ab82-c35437335431 req-e1926021-8c02-46fb-9f07-c3a9157867c0 service nova] Creating event network-vif-deleted:8cebef39-d819-436e-9047-40d02c752d9e for instance bdeeb437-76a3-49b5-9553-d2da74917d69 on user Apr 19 08:09:38 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-0cc1d240-485b-4be7-ab82-c35437335431 req-e1926021-8c02-46fb-9f07-c3a9157867c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035273 Apr 19 08:09:38 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 113/337] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:09:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:09:39 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-8cbcb7be-df44-487b-aa85-12ac6e415709 req-be39c41f-8aca-43c5-a982-7c6ebb3726ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdeeb437-76a3-49b5-9553-d2da74917d69", "name": "network-vif-plugged", "status": "completed", "tag": "8cebef39-d819-436e-9047-40d02c752d9e"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:09:39 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-8cbcb7be-df44-487b-aa85-12ac6e415709 req-be39c41f-8aca-43c5-a982-7c6ebb3726ce service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:39 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-8cbcb7be-df44-487b-aa85-12ac6e415709 req-be39c41f-8aca-43c5-a982-7c6ebb3726ce service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:39 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-8cbcb7be-df44-487b-aa85-12ac6e415709 req-be39c41f-8aca-43c5-a982-7c6ebb3726ce service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:39 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-8cbcb7be-df44-487b-aa85-12ac6e415709 req-be39c41f-8aca-43c5-a982-7c6ebb3726ce service nova] Creating event network-vif-plugged:8cebef39-d819-436e-9047-40d02c752d9e for instance bdeeb437-76a3-49b5-9553-d2da74917d69 on user Apr 19 08:09:39 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-8cbcb7be-df44-487b-aa85-12ac6e415709 req-be39c41f-8aca-43c5-a982-7c6ebb3726ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028700 Apr 19 08:09:39 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 115/338] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:09:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:09:49 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-6959d78a-ebde-49d4-969d-8e68db45cd12 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:09:49 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-6959d78a-ebde-49d4-969d-8e68db45cd12 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 823c04fd-d328-4013-ac57-d5c32255c8b1] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:09:49 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:49 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=6 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:49 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-6959d78a-ebde-49d4-969d-8e68db45cd12 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:49 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-6959d78a-ebde-49d4-969d-8e68db45cd12 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:49 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-6959d78a-ebde-49d4-969d-8e68db45cd12 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:49 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-6959d78a-ebde-49d4-969d-8e68db45cd12 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:49 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-6959d78a-ebde-49d4-969d-8e68db45cd12 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:49 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-6959d78a-ebde-49d4-969d-8e68db45cd12 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:49 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-6959d78a-ebde-49d4-969d-8e68db45cd12 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:49 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-6959d78a-ebde-49d4-969d-8e68db45cd12 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:49 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-6959d78a-ebde-49d4-969d-8e68db45cd12 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:49 user devstack@n-api.service[61209]: DEBUG nova.objects.instance [None req-6959d78a-ebde-49d4-969d-8e68db45cd12 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lazy-loading 'fault' on Instance uuid 823c04fd-d328-4013-ac57-d5c32255c8b1 {{(pid=61209) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 19 08:09:49 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-6959d78a-ebde-49d4-969d-8e68db45cd12 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:09:49 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-6959d78a-ebde-49d4-969d-8e68db45cd12 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:09:49 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-6959d78a-ebde-49d4-969d-8e68db45cd12 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:09:49 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-6959d78a-ebde-49d4-969d-8e68db45cd12 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/823c04fd-d328-4013-ac57-d5c32255c8b1" status: 200 len: 1650 microversion: 2.87 time: 0.140574 Apr 19 08:09:49 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 111/339] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:09:49 2023] GET /compute/v2.1/servers/823c04fd-d328-4013-ac57-d5c32255c8b1 => generated 1650 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 08:09:50 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-ad031fe5-fea2-48cf-a974-8ebd9f1b1cc4 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:09:50 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-ad031fe5-fea2-48cf-a974-8ebd9f1b1cc4 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 823c04fd-d328-4013-ac57-d5c32255c8b1] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:09:50 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:50 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:50 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-ad031fe5-fea2-48cf-a974-8ebd9f1b1cc4 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:50 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-ad031fe5-fea2-48cf-a974-8ebd9f1b1cc4 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:50 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-ad031fe5-fea2-48cf-a974-8ebd9f1b1cc4 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:50 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-ad031fe5-fea2-48cf-a974-8ebd9f1b1cc4 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:50 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-ad031fe5-fea2-48cf-a974-8ebd9f1b1cc4 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:50 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-ad031fe5-fea2-48cf-a974-8ebd9f1b1cc4 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:50 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-ad031fe5-fea2-48cf-a974-8ebd9f1b1cc4 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 823c04fd-d328-4013-ac57-d5c32255c8b1] Going to try to terminate instance {{(pid=61208) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:09:50 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-ad031fe5-fea2-48cf-a974-8ebd9f1b1cc4 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 823c04fd-d328-4013-ac57-d5c32255c8b1] Doing local delete in cell bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10(cell1) {{(pid=61208) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 19 08:09:50 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-ad031fe5-fea2-48cf-a974-8ebd9f1b1cc4 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:50 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-ad031fe5-fea2-48cf-a974-8ebd9f1b1cc4 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:50 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-ad031fe5-fea2-48cf-a974-8ebd9f1b1cc4 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:50 user devstack@n-api.service[61208]: WARNING nova.compute.api [None req-ad031fe5-fea2-48cf-a974-8ebd9f1b1cc4 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 823c04fd-d328-4013-ac57-d5c32255c8b1] instance's host None is down, deleting from database Apr 19 08:09:50 user devstack@n-api.service[61208]: DEBUG nova.network.neutron [None req-ad031fe5-fea2-48cf-a974-8ebd9f1b1cc4 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 823c04fd-d328-4013-ac57-d5c32255c8b1] deallocate_for_instance() {{(pid=61208) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 19 08:09:50 user devstack@n-api.service[61208]: DEBUG nova.network.neutron [None req-ad031fe5-fea2-48cf-a974-8ebd9f1b1cc4 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 823c04fd-d328-4013-ac57-d5c32255c8b1] Instance cache missing network info. {{(pid=61208) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 19 08:09:50 user devstack@n-api.service[61208]: DEBUG nova.network.neutron [None req-ad031fe5-fea2-48cf-a974-8ebd9f1b1cc4 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 823c04fd-d328-4013-ac57-d5c32255c8b1] Updating instance_info_cache with network_info: [] {{(pid=61208) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 19 08:09:50 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-ad031fe5-fea2-48cf-a974-8ebd9f1b1cc4 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 823c04fd-d328-4013-ac57-d5c32255c8b1] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61208) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 19 08:09:50 user devstack@n-api.service[61208]: WARNING nova.compute.api [None req-ad031fe5-fea2-48cf-a974-8ebd9f1b1cc4 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 823c04fd-d328-4013-ac57-d5c32255c8b1] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 19 08:09:50 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-ad031fe5-fea2-48cf-a974-8ebd9f1b1cc4 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/823c04fd-d328-4013-ac57-d5c32255c8b1" status: 204 len: 0 microversion: 2.87 time: 0.729524 Apr 19 08:09:50 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 114/340] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 08:09:50 2023] DELETE /compute/v2.1/servers/823c04fd-d328-4013-ac57-d5c32255c8b1 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 08:09:50 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=4 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:50 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=4 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:09:50 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-063fbcaf-494b-4a3b-af1f-25fd8042a4ce tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:09:50 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-063fbcaf-494b-4a3b-af1f-25fd8042a4ce tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 823c04fd-d328-4013-ac57-d5c32255c8b1] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:09:50 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-063fbcaf-494b-4a3b-af1f-25fd8042a4ce tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:50 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-063fbcaf-494b-4a3b-af1f-25fd8042a4ce tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:50 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-063fbcaf-494b-4a3b-af1f-25fd8042a4ce tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:50 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-063fbcaf-494b-4a3b-af1f-25fd8042a4ce tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:50 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-063fbcaf-494b-4a3b-af1f-25fd8042a4ce tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:50 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-063fbcaf-494b-4a3b-af1f-25fd8042a4ce tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:50 user devstack@n-api.service[61210]: INFO nova.api.openstack.wsgi [None req-063fbcaf-494b-4a3b-af1f-25fd8042a4ce tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] HTTP exception thrown: Instance 823c04fd-d328-4013-ac57-d5c32255c8b1 could not be found. Apr 19 08:09:50 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-063fbcaf-494b-4a3b-af1f-25fd8042a4ce tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Request method failure captured: Apr 19 08:09:50 user devstack@n-api.service[61210]: request: GET /compute/v2.1/servers/823c04fd-d328-4013-ac57-d5c32255c8b1 HTTP/1.1 Apr 19 08:09:50 user devstack@n-api.service[61210]: Accept: application/json Apr 19 08:09:50 user devstack@n-api.service[61210]: Accept-Encoding: identity Apr 19 08:09:50 user devstack@n-api.service[61210]: Connection: close Apr 19 08:09:50 user devstack@n-api.service[61210]: Content-Length: 0 Apr 19 08:09:50 user devstack@n-api.service[61210]: Content-Type: application/json Apr 19 08:09:50 user devstack@n-api.service[61210]: Host: 10.0.0.210 Apr 19 08:09:50 user devstack@n-api.service[61210]: Openstack-System-Scope: None Apr 19 08:09:50 user devstack@n-api.service[61210]: User-Agent: python-urllib3/1.26.15 Apr 19 08:09:50 user devstack@n-api.service[61210]: X-Auth-Token: gAAAAABkP6Dp-ckklASsHR16Ty1V7tF5AaUkLgi1XHB_iUkWABV1TkB4TpQkzf2iSTsseQeGeK2gtuAPoCcF1Ie_2B9XFXfoQNGiZe9mud6O87gqX4drt8Tr5iI4jC18u0EZt5ZKgabAj35kP5xKdQjnBhFPWeyepSIbrWYy3pDb-H_U9YiRHV8 Apr 19 08:09:50 user devstack@n-api.service[61210]: X-Domain-Id: None Apr 19 08:09:50 user devstack@n-api.service[61210]: X-Domain-Name: None Apr 19 08:09:50 user devstack@n-api.service[61210]: X-Identity-Status: Confirmed Apr 19 08:09:50 user devstack@n-api.service[61210]: X-Is-Admin-Project: True Apr 19 08:09:50 user devstack@n-api.service[61210]: X-Openstack-Nova-Api-Version: 2.87 Apr 19 08:09:50 user devstack@n-api.service[61210]: X-Project-Domain-Id: default Apr 19 08:09:50 user devstack@n-api.service[61210]: X-Project-Domain-Name: Default Apr 19 08:09:50 user devstack@n-api.service[61210]: X-Project-Id: 7973fa0075de42e9a74627ae9cd98d9f Apr 19 08:09:50 user devstack@n-api.service[61210]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2017668221 Apr 19 08:09:50 user devstack@n-api.service[61210]: X-Role: reader,member Apr 19 08:09:50 user devstack@n-api.service[61210]: X-Roles: reader,member Apr 19 08:09:50 user devstack@n-api.service[61210]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7973fa0075de42e9a74627ae9cd98d9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7973fa0075de42e9a74627ae9cd98d9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7973fa0075de42e9a74627ae9cd98d9f"}]}] Apr 19 08:09:50 user devstack@n-api.service[61210]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2017668221 Apr 19 08:09:50 user devstack@n-api.service[61210]: X-Tenant-Id: 7973fa0075de42e9a74627ae9cd98d9f Apr 19 08:09:50 user devstack@n-api.service[61210]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2017668221 Apr 19 08:09:50 user devstack@n-api.service[61210]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member Apr 19 08:09:50 user devstack@n-api.service[61210]: X-User-Domain-Id: default Apr 19 08:09:50 user devstack@n-api.service[61210]: X-User-Domain-Name: Default Apr 19 08:09:50 user devstack@n-api.service[61210]: X-User-Id: 5530f99504de4426ba41cfa691c430c0 Apr 19 08:09:50 user devstack@n-api.service[61210]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member Apr 19 08:09:50 user devstack@n-api.service[61210]: method: > Apr 19 08:09:50 user devstack@n-api.service[61210]: exception: Instance 823c04fd-d328-4013-ac57-d5c32255c8b1 could not be found. Apr 19 08:09:50 user devstack@n-api.service[61210]: action_args: {'id': '823c04fd-d328-4013-ac57-d5c32255c8b1'} Apr 19 08:09:50 user devstack@n-api.service[61210]: {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 823c04fd-d328-4013-ac57-d5c32255c8b1 could not be found. Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 823c04fd-d328-4013-ac57-d5c32255c8b1 could not be found. Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 823c04fd-d328-4013-ac57-d5c32255c8b1 could not be found. Apr 19 08:09:50 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:09:50 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-063fbcaf-494b-4a3b-af1f-25fd8042a4ce tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Returning 404 to user: Instance 823c04fd-d328-4013-ac57-d5c32255c8b1 could not be found. {{(pid=61210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:09:50 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-063fbcaf-494b-4a3b-af1f-25fd8042a4ce tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/823c04fd-d328-4013-ac57-d5c32255c8b1" status: 404 len: 111 microversion: 2.87 time: 0.043934 Apr 19 08:09:50 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 116/341] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:09:50 2023] GET /compute/v2.1/servers/823c04fd-d328-4013-ac57-d5c32255c8b1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 08:09:50 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-3c20a751-2abf-4638-9ba8-263546b1088d tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1888275756", "imageRef": "b515545f-3b22-4d80-a102-6a318ab9717a", "flavorRef": "42", "networks": [{"uuid": "c200dc82-8f76-41a5-8f0d-25b3fdcf2132"}]}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:09:50 user devstack@n-api.service[61209]: DEBUG nova.network.neutron [None req-3c20a751-2abf-4638-9ba8-263546b1088d tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] validate_networks() for [('c200dc82-8f76-41a5-8f0d-25b3fdcf2132', None, None, None, None, None)] {{(pid=61209) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 08:09:51 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-3c20a751-2abf-4638-9ba8-263546b1088d tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Flavor limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 08:09:51 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-3c20a751-2abf-4638-9ba8-263546b1088d tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Image limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 08:09:51 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-3c20a751-2abf-4638-9ba8-263546b1088d tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Flavor pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 08:09:51 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-3c20a751-2abf-4638-9ba8-263546b1088d tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Image pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 08:09:51 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-3c20a751-2abf-4638-9ba8-263546b1088d tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 08:09:51 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-3c20a751-2abf-4638-9ba8-263546b1088d tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:51 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-3c20a751-2abf-4638-9ba8-263546b1088d tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:51 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-3c20a751-2abf-4638-9ba8-263546b1088d tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:51 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-3c20a751-2abf-4638-9ba8-263546b1088d tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:51 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-3c20a751-2abf-4638-9ba8-263546b1088d tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:51 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-3c20a751-2abf-4638-9ba8-263546b1088d tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:51 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-3c20a751-2abf-4638-9ba8-263546b1088d tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Getting quotas for project 7973fa0075de42e9a74627ae9cd98d9f. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:09:51 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-3c20a751-2abf-4638-9ba8-263546b1088d tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Getting quotas for user 5530f99504de4426ba41cfa691c430c0 and project 7973fa0075de42e9a74627ae9cd98d9f. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:09:51 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-3c20a751-2abf-4638-9ba8-263546b1088d tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Going to run 1 instances... {{(pid=61209) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 08:09:51 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-3c20a751-2abf-4638-9ba8-263546b1088d tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 092ebf79-b95c-460d-8f90-28d4e4a7ce7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b515545f-3b22-4d80-a102-6a318ab9717a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 08:09:51 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-3c20a751-2abf-4638-9ba8-263546b1088d tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.597891 Apr 19 08:09:51 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 112/342] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 08:09:50 2023] POST /compute/v2.1/servers => generated 378 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 19 08:09:51 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-7ddec906-d2c0-4674-9356-4670378bd1ac tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:09:51 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-7ddec906-d2c0-4674-9356-4670378bd1ac tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 092ebf79-b95c-460d-8f90-28d4e4a7ce7e] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:09:51 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-7ddec906-d2c0-4674-9356-4670378bd1ac tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:09:51 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-7ddec906-d2c0-4674-9356-4670378bd1ac tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:09:51 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-7ddec906-d2c0-4674-9356-4670378bd1ac tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:09:51 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-7ddec906-d2c0-4674-9356-4670378bd1ac tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/092ebf79-b95c-460d-8f90-28d4e4a7ce7e" status: 200 len: 1395 microversion: 2.87 time: 0.090337 Apr 19 08:09:51 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 115/343] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:09:51 2023] GET /compute/v2.1/servers/092ebf79-b95c-460d-8f90-28d4e4a7ce7e => generated 1395 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 08:09:54 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-0b8373cc-f8a7-43ab-974a-f2289f270b2d req-6df95e1a-8332-42a9-99ed-f1c591a3ec87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "092ebf79-b95c-460d-8f90-28d4e4a7ce7e", "tag": "49511f6f-4e05-454b-afda-974e537666cb"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:09:54 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-0b8373cc-f8a7-43ab-974a-f2289f270b2d req-6df95e1a-8332-42a9-99ed-f1c591a3ec87 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:54 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-0b8373cc-f8a7-43ab-974a-f2289f270b2d req-6df95e1a-8332-42a9-99ed-f1c591a3ec87 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:54 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-0b8373cc-f8a7-43ab-974a-f2289f270b2d req-6df95e1a-8332-42a9-99ed-f1c591a3ec87 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:54 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-0b8373cc-f8a7-43ab-974a-f2289f270b2d req-6df95e1a-8332-42a9-99ed-f1c591a3ec87 service nova] Creating event network-changed:49511f6f-4e05-454b-afda-974e537666cb for instance 092ebf79-b95c-460d-8f90-28d4e4a7ce7e on user Apr 19 08:09:54 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-0b8373cc-f8a7-43ab-974a-f2289f270b2d req-6df95e1a-8332-42a9-99ed-f1c591a3ec87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099954 Apr 19 08:09:54 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 117/344] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:09:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:09:55 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-a775b360-652f-4583-b6b3-ae22a942a3b4 req-b78d64ae-10a1-4000-8333-8630dfb1b0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092ebf79-b95c-460d-8f90-28d4e4a7ce7e", "name": "network-vif-plugged", "status": "completed", "tag": "49511f6f-4e05-454b-afda-974e537666cb"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:09:55 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-a775b360-652f-4583-b6b3-ae22a942a3b4 req-b78d64ae-10a1-4000-8333-8630dfb1b0f1 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:55 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-a775b360-652f-4583-b6b3-ae22a942a3b4 req-b78d64ae-10a1-4000-8333-8630dfb1b0f1 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:55 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-a775b360-652f-4583-b6b3-ae22a942a3b4 req-b78d64ae-10a1-4000-8333-8630dfb1b0f1 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:55 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-a775b360-652f-4583-b6b3-ae22a942a3b4 req-b78d64ae-10a1-4000-8333-8630dfb1b0f1 service nova] Creating event network-vif-plugged:49511f6f-4e05-454b-afda-974e537666cb for instance 092ebf79-b95c-460d-8f90-28d4e4a7ce7e on user Apr 19 08:09:55 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-a775b360-652f-4583-b6b3-ae22a942a3b4 req-b78d64ae-10a1-4000-8333-8630dfb1b0f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032958 Apr 19 08:09:55 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 113/345] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:09:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:09:57 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-946a809c-64af-4cd6-9964-0fd82457d2c7 req-29753bc7-6288-479c-b08e-f280a1eaf7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092ebf79-b95c-460d-8f90-28d4e4a7ce7e", "name": "network-vif-plugged", "status": "completed", "tag": "49511f6f-4e05-454b-afda-974e537666cb"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:09:57 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-946a809c-64af-4cd6-9964-0fd82457d2c7 req-29753bc7-6288-479c-b08e-f280a1eaf7e8 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:09:57 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-946a809c-64af-4cd6-9964-0fd82457d2c7 req-29753bc7-6288-479c-b08e-f280a1eaf7e8 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:09:57 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-946a809c-64af-4cd6-9964-0fd82457d2c7 req-29753bc7-6288-479c-b08e-f280a1eaf7e8 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:09:57 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-946a809c-64af-4cd6-9964-0fd82457d2c7 req-29753bc7-6288-479c-b08e-f280a1eaf7e8 service nova] Creating event network-vif-plugged:49511f6f-4e05-454b-afda-974e537666cb for instance 092ebf79-b95c-460d-8f90-28d4e4a7ce7e on user Apr 19 08:09:57 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-946a809c-64af-4cd6-9964-0fd82457d2c7 req-29753bc7-6288-479c-b08e-f280a1eaf7e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062666 Apr 19 08:09:57 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 116/346] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:09:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:10:07 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=4 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:10:07 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=4 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:10:07 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-4459e89a-b026-4d06-94e8-4f4af1e15046 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:10:07 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-4459e89a-b026-4d06-94e8-4f4af1e15046 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] [instance: 7be61ae3-a9cd-4a68-8494-395f685ff6ee] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:10:07 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-4459e89a-b026-4d06-94e8-4f4af1e15046 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:10:07 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-4459e89a-b026-4d06-94e8-4f4af1e15046 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:10:07 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-4459e89a-b026-4d06-94e8-4f4af1e15046 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:10:07 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-4459e89a-b026-4d06-94e8-4f4af1e15046 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:10:07 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-4459e89a-b026-4d06-94e8-4f4af1e15046 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:10:07 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-4459e89a-b026-4d06-94e8-4f4af1e15046 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:10:08 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-4459e89a-b026-4d06-94e8-4f4af1e15046 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d79080dd7b4e20932eb3774bdc97a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f475ef63d11f4decbd33dfc63e108d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:10:08 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-4459e89a-b026-4d06-94e8-4f4af1e15046 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0d79080dd7b4e20932eb3774bdc97a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f475ef63d11f4decbd33dfc63e108d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:10:08 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-4459e89a-b026-4d06-94e8-4f4af1e15046 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0d79080dd7b4e20932eb3774bdc97a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f475ef63d11f4decbd33dfc63e108d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:10:08 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-4459e89a-b026-4d06-94e8-4f4af1e15046 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7be61ae3-a9cd-4a68-8494-395f685ff6ee" status: 200 len: 1585 microversion: 2.20 time: 0.273563 Apr 19 08:10:08 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 118/347] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:10:07 2023] GET /compute/v2.1/servers/7be61ae3-a9cd-4a68-8494-395f685ff6ee => generated 1585 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 08:10:22 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:10:22 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=6 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:10:22 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:10:22 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=12 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:10:22 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-b8374d0c-2c5e-42c3-a197-4abeaee081b4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:10:22 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-b8374d0c-2c5e-42c3-a197-4abeaee081b4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] [instance: 266d27ff-db1d-443a-8562-b67a859afe20] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:10:22 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b8374d0c-2c5e-42c3-a197-4abeaee081b4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:10:22 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b8374d0c-2c5e-42c3-a197-4abeaee081b4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:10:22 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b8374d0c-2c5e-42c3-a197-4abeaee081b4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:10:22 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b8374d0c-2c5e-42c3-a197-4abeaee081b4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:10:22 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b8374d0c-2c5e-42c3-a197-4abeaee081b4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:10:22 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b8374d0c-2c5e-42c3-a197-4abeaee081b4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:10:23 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-b8374d0c-2c5e-42c3-a197-4abeaee081b4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2027c586717a407baa7cd8f3cdc56459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f98320d1745918cc7e2ca0ddf0ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:10:23 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-b8374d0c-2c5e-42c3-a197-4abeaee081b4 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/266d27ff-db1d-443a-8562-b67a859afe20" status: 200 len: 1493 microversion: 2.1 time: 0.244364 Apr 19 08:10:23 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 114/348] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:10:22 2023] GET /compute/v2.1/servers/266d27ff-db1d-443a-8562-b67a859afe20 => generated 1493 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:10:27 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:10:27 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:10:27 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:10:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-7efa6688-5235-4ad5-9c01-e3aaad88e08b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:10:27 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-7efa6688-5235-4ad5-9c01-e3aaad88e08b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] [instance: bdeeb437-76a3-49b5-9553-d2da74917d69] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:10:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7efa6688-5235-4ad5-9c01-e3aaad88e08b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:10:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7efa6688-5235-4ad5-9c01-e3aaad88e08b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:10:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7efa6688-5235-4ad5-9c01-e3aaad88e08b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:10:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7efa6688-5235-4ad5-9c01-e3aaad88e08b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:10:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7efa6688-5235-4ad5-9c01-e3aaad88e08b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:10:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7efa6688-5235-4ad5-9c01-e3aaad88e08b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:10:27 user devstack@n-api.service[61208]: INFO nova.api.openstack.wsgi [None req-7efa6688-5235-4ad5-9c01-e3aaad88e08b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] HTTP exception thrown: Instance bdeeb437-76a3-49b5-9553-d2da74917d69 could not be found. Apr 19 08:10:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-7efa6688-5235-4ad5-9c01-e3aaad88e08b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Request method failure captured: Apr 19 08:10:27 user devstack@n-api.service[61208]: request: GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69 HTTP/1.1 Apr 19 08:10:27 user devstack@n-api.service[61208]: Accept: application/json Apr 19 08:10:27 user devstack@n-api.service[61208]: Accept-Encoding: identity Apr 19 08:10:27 user devstack@n-api.service[61208]: Connection: close Apr 19 08:10:27 user devstack@n-api.service[61208]: Content-Length: 0 Apr 19 08:10:27 user devstack@n-api.service[61208]: Content-Type: application/json Apr 19 08:10:27 user devstack@n-api.service[61208]: Host: 10.0.0.210 Apr 19 08:10:27 user devstack@n-api.service[61208]: Openstack-System-Scope: None Apr 19 08:10:27 user devstack@n-api.service[61208]: User-Agent: python-urllib3/1.26.15 Apr 19 08:10:27 user devstack@n-api.service[61208]: X-Auth-Token: gAAAAABkP5-qrpfkq9FKmX3lCJIBvggo6RtEuuGhpy-mxo5Ouxq5_eMH7I3hPvO_jh5c_EZJDxSOjauc11Ds1x-f3SlXmvlNzE_GhRc7Va-JRM5WcD6hTF0T7GXQdvpTdXDjT0edYEyPgU2E95gIHzlm9jG0daAOwaAKZzxyL6zCrCztIM-E3Zc Apr 19 08:10:27 user devstack@n-api.service[61208]: X-Domain-Id: None Apr 19 08:10:27 user devstack@n-api.service[61208]: X-Domain-Name: None Apr 19 08:10:27 user devstack@n-api.service[61208]: X-Identity-Status: Confirmed Apr 19 08:10:27 user devstack@n-api.service[61208]: X-Is-Admin-Project: True Apr 19 08:10:27 user devstack@n-api.service[61208]: X-Project-Domain-Id: default Apr 19 08:10:27 user devstack@n-api.service[61208]: X-Project-Domain-Name: Default Apr 19 08:10:27 user devstack@n-api.service[61208]: X-Project-Id: ebcde8c2a3444e919d232ea854c00e6f Apr 19 08:10:27 user devstack@n-api.service[61208]: X-Project-Name: tempest-ServerActionsTestJSON-181616281 Apr 19 08:10:27 user devstack@n-api.service[61208]: X-Role: reader,member Apr 19 08:10:27 user devstack@n-api.service[61208]: X-Roles: reader,member Apr 19 08:10:27 user devstack@n-api.service[61208]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ebcde8c2a3444e919d232ea854c00e6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ebcde8c2a3444e919d232ea854c00e6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ebcde8c2a3444e919d232ea854c00e6f"}]}] Apr 19 08:10:27 user devstack@n-api.service[61208]: X-Tenant: tempest-ServerActionsTestJSON-181616281 Apr 19 08:10:27 user devstack@n-api.service[61208]: X-Tenant-Id: ebcde8c2a3444e919d232ea854c00e6f Apr 19 08:10:27 user devstack@n-api.service[61208]: X-Tenant-Name: tempest-ServerActionsTestJSON-181616281 Apr 19 08:10:27 user devstack@n-api.service[61208]: X-User: tempest-ServerActionsTestJSON-181616281-project-member Apr 19 08:10:27 user devstack@n-api.service[61208]: X-User-Domain-Id: default Apr 19 08:10:27 user devstack@n-api.service[61208]: X-User-Domain-Name: Default Apr 19 08:10:27 user devstack@n-api.service[61208]: X-User-Id: 16dc2a88f2d149a1a4035ed1c7e74b45 Apr 19 08:10:27 user devstack@n-api.service[61208]: X-User-Name: tempest-ServerActionsTestJSON-181616281-project-member Apr 19 08:10:27 user devstack@n-api.service[61208]: method: > Apr 19 08:10:27 user devstack@n-api.service[61208]: exception: Instance bdeeb437-76a3-49b5-9553-d2da74917d69 could not be found. Apr 19 08:10:27 user devstack@n-api.service[61208]: action_args: {'id': 'bdeeb437-76a3-49b5-9553-d2da74917d69'} Apr 19 08:10:27 user devstack@n-api.service[61208]: {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdeeb437-76a3-49b5-9553-d2da74917d69 could not be found. Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdeeb437-76a3-49b5-9553-d2da74917d69 could not be found. Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdeeb437-76a3-49b5-9553-d2da74917d69 could not be found. Apr 19 08:10:27 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:10:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-7efa6688-5235-4ad5-9c01-e3aaad88e08b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Returning 404 to user: Instance bdeeb437-76a3-49b5-9553-d2da74917d69 could not be found. {{(pid=61208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:10:27 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-7efa6688-5235-4ad5-9c01-e3aaad88e08b tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69" status: 404 len: 111 microversion: 2.1 time: 0.061834 Apr 19 08:10:27 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 117/349] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:10:27 2023] GET /compute/v2.1/servers/bdeeb437-76a3-49b5-9553-d2da74917d69 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:10:27 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-18bff39c-2d98-46c2-b410-59d7c27b7b8e tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] Calling method '.version_select at 0x7f2c01052e60>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:10:27 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=2 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:10:27 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=6 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:10:27 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-18bff39c-2d98-46c2-b410-59d7c27b7b8e tempest-ServerActionsTestJSON-181616281 tempest-ServerActionsTestJSON-181616281-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1127111588" status: 202 len: 0 microversion: 2.1 time: 0.029150 Apr 19 08:10:27 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 119/350] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 08:10:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1127111588 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 08:10:41 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-59c079ec-a967-433d-bf78-e37ea7b265a9 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:10:41 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-59c079ec-a967-433d-bf78-e37ea7b265a9 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 092ebf79-b95c-460d-8f90-28d4e4a7ce7e] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:10:41 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:10:41 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=6 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:10:41 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-59c079ec-a967-433d-bf78-e37ea7b265a9 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:10:41 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-59c079ec-a967-433d-bf78-e37ea7b265a9 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:10:41 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-59c079ec-a967-433d-bf78-e37ea7b265a9 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:10:41 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-59c079ec-a967-433d-bf78-e37ea7b265a9 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:10:41 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-59c079ec-a967-433d-bf78-e37ea7b265a9 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:10:41 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-59c079ec-a967-433d-bf78-e37ea7b265a9 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:10:41 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-59c079ec-a967-433d-bf78-e37ea7b265a9 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:10:41 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-59c079ec-a967-433d-bf78-e37ea7b265a9 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:10:41 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-59c079ec-a967-433d-bf78-e37ea7b265a9 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:10:41 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-59c079ec-a967-433d-bf78-e37ea7b265a9 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/092ebf79-b95c-460d-8f90-28d4e4a7ce7e" status: 200 len: 1691 microversion: 2.87 time: 0.251410 Apr 19 08:10:41 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 115/351] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:10:41 2023] GET /compute/v2.1/servers/092ebf79-b95c-460d-8f90-28d4e4a7ce7e => generated 1691 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 08:11:03 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:11:03 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:11:03 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-3aac1c30-6302-4b29-96ae-c695757e2454 tempest-TestShelveInstance-1742788410 tempest-TestShelveInstance-1742788410-project-member] Action: 'create', calling method: .version_select at 0x7f2c00e58430>, body: {"keypair": {"name": "tempest-TestShelveInstance-1976437938", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFykRzqZfXPQhjrLbfDEY30Z0WXZhr2bdy2JQcaM6an9puCvnkGjpwmr/r2WGOkZZ40DaHFb1Lxp01UcDD/RJwnzRDPUakVpzVV/y6fMLtfxbFS1pbjtRwPGHvoQD9sv2w=="}} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:11:03 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-3aac1c30-6302-4b29-96ae-c695757e2454 tempest-TestShelveInstance-1742788410 tempest-TestShelveInstance-1742788410-project-member] Getting quotas for project df58c902a7404951b7bd8fb964d08de2. Resources: {'key_pairs'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:11:03 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-3aac1c30-6302-4b29-96ae-c695757e2454 tempest-TestShelveInstance-1742788410 tempest-TestShelveInstance-1742788410-project-member] Getting quotas for user 84e50f8867b7417c926d058c4ec72987 and project df58c902a7404951b7bd8fb964d08de2. Resources: {'key_pairs'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:11:03 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-3aac1c30-6302-4b29-96ae-c695757e2454 tempest-TestShelveInstance-1742788410 tempest-TestShelveInstance-1742788410-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.324982 Apr 19 08:11:03 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 118/352] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 08:11:03 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:11:06 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:11:06 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-e8815e38-c498-4053-bc5a-82e653ed951c tempest-TestShelveInstance-1742788410 tempest-TestShelveInstance-1742788410-project-member] Calling method '.version_select at 0x7f2c01051ab0>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:11:06 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-e8815e38-c498-4053-bc5a-82e653ed951c tempest-TestShelveInstance-1742788410 tempest-TestShelveInstance-1742788410-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1976437938" status: 202 len: 0 microversion: 2.1 time: 0.024817 Apr 19 08:11:06 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 120/353] 10.0.0.210 () {62 vars in 1331 bytes} [Wed Apr 19 08:11:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1976437938 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 08:11:08 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-28138566-f7e8-4363-96e8-d6c04feb63f6 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:11:08 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-28138566-f7e8-4363-96e8-d6c04feb63f6 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] [instance: 7be61ae3-a9cd-4a68-8494-395f685ff6ee] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:11:08 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=6 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:11:08 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=4 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:11:08 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-28138566-f7e8-4363-96e8-d6c04feb63f6 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:11:08 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-28138566-f7e8-4363-96e8-d6c04feb63f6 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:11:08 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-28138566-f7e8-4363-96e8-d6c04feb63f6 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:11:08 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-28138566-f7e8-4363-96e8-d6c04feb63f6 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:11:08 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-28138566-f7e8-4363-96e8-d6c04feb63f6 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:11:08 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-28138566-f7e8-4363-96e8-d6c04feb63f6 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:11:08 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-28138566-f7e8-4363-96e8-d6c04feb63f6 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7be61ae3-a9cd-4a68-8494-395f685ff6ee/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.201853 Apr 19 08:11:08 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 116/354] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 19 08:11:08 2023] GET /compute/v2.1/servers/7be61ae3-a9cd-4a68-8494-395f685ff6ee/os-interface => generated 282 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 08:11:09 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-26a99d54-b12e-479d-a7bf-80c4f91ff449 req-6bf8ba3c-dda4-425f-a472-340c7a2bcaa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7be61ae3-a9cd-4a68-8494-395f685ff6ee", "tag": "3f2753b2-3728-4d4a-8238-f08e4d03e465"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:11:09 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-26a99d54-b12e-479d-a7bf-80c4f91ff449 req-6bf8ba3c-dda4-425f-a472-340c7a2bcaa0 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:11:09 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-26a99d54-b12e-479d-a7bf-80c4f91ff449 req-6bf8ba3c-dda4-425f-a472-340c7a2bcaa0 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:11:09 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-26a99d54-b12e-479d-a7bf-80c4f91ff449 req-6bf8ba3c-dda4-425f-a472-340c7a2bcaa0 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:11:09 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-26a99d54-b12e-479d-a7bf-80c4f91ff449 req-6bf8ba3c-dda4-425f-a472-340c7a2bcaa0 service nova] Creating event network-changed:3f2753b2-3728-4d4a-8238-f08e4d03e465 for instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee on user Apr 19 08:11:09 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-26a99d54-b12e-479d-a7bf-80c4f91ff449 req-6bf8ba3c-dda4-425f-a472-340c7a2bcaa0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042420 Apr 19 08:11:09 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 119/355] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:11:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:11:09 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-28a3667a-0364-4a67-8d85-1a0ceac43edb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:11:09 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-28a3667a-0364-4a67-8d85-1a0ceac43edb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] [instance: 7be61ae3-a9cd-4a68-8494-395f685ff6ee] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:11:09 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-28a3667a-0364-4a67-8d85-1a0ceac43edb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:11:09 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-28a3667a-0364-4a67-8d85-1a0ceac43edb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:11:09 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-28a3667a-0364-4a67-8d85-1a0ceac43edb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:11:09 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-28a3667a-0364-4a67-8d85-1a0ceac43edb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:11:09 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-28a3667a-0364-4a67-8d85-1a0ceac43edb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:11:09 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-28a3667a-0364-4a67-8d85-1a0ceac43edb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:11:09 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-28a3667a-0364-4a67-8d85-1a0ceac43edb tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7be61ae3-a9cd-4a68-8494-395f685ff6ee/ips" status: 200 len: 109 microversion: 2.20 time: 0.035041 Apr 19 08:11:09 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 121/356] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 19 08:11:09 2023] GET /compute/v2.1/servers/7be61ae3-a9cd-4a68-8494-395f685ff6ee/ips => generated 109 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 19 08:11:10 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-247c4ab4-c24e-4ca1-99d7-28c35bda04ee tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:11:10 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-247c4ab4-c24e-4ca1-99d7-28c35bda04ee tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] [instance: 7be61ae3-a9cd-4a68-8494-395f685ff6ee] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:11:10 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-247c4ab4-c24e-4ca1-99d7-28c35bda04ee tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:11:10 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-247c4ab4-c24e-4ca1-99d7-28c35bda04ee tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:11:10 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-247c4ab4-c24e-4ca1-99d7-28c35bda04ee tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:11:10 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-247c4ab4-c24e-4ca1-99d7-28c35bda04ee tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:11:10 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-247c4ab4-c24e-4ca1-99d7-28c35bda04ee tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:11:10 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-247c4ab4-c24e-4ca1-99d7-28c35bda04ee tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:11:10 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-247c4ab4-c24e-4ca1-99d7-28c35bda04ee tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] [instance: 7be61ae3-a9cd-4a68-8494-395f685ff6ee] Going to try to terminate instance {{(pid=61209) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:11:11 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-247c4ab4-c24e-4ca1-99d7-28c35bda04ee tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7be61ae3-a9cd-4a68-8494-395f685ff6ee" status: 204 len: 0 microversion: 2.20 time: 0.310518 Apr 19 08:11:11 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 117/357] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 08:11:10 2023] DELETE /compute/v2.1/servers/7be61ae3-a9cd-4a68-8494-395f685ff6ee => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 08:11:11 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-7f04a860-0ed0-4a37-bbec-a8534b41b697 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:11:11 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-7f04a860-0ed0-4a37-bbec-a8534b41b697 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] [instance: 7be61ae3-a9cd-4a68-8494-395f685ff6ee] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:11:11 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7f04a860-0ed0-4a37-bbec-a8534b41b697 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:11:11 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7f04a860-0ed0-4a37-bbec-a8534b41b697 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:11:11 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7f04a860-0ed0-4a37-bbec-a8534b41b697 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:11:11 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7f04a860-0ed0-4a37-bbec-a8534b41b697 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:11:11 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7f04a860-0ed0-4a37-bbec-a8534b41b697 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:11:11 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-7f04a860-0ed0-4a37-bbec-a8534b41b697 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:11:11 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-7f04a860-0ed0-4a37-bbec-a8534b41b697 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0d79080dd7b4e20932eb3774bdc97a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f475ef63d11f4decbd33dfc63e108d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:11:11 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-7f04a860-0ed0-4a37-bbec-a8534b41b697 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0d79080dd7b4e20932eb3774bdc97a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f475ef63d11f4decbd33dfc63e108d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:11:11 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-7f04a860-0ed0-4a37-bbec-a8534b41b697 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0d79080dd7b4e20932eb3774bdc97a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f475ef63d11f4decbd33dfc63e108d12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:11:11 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-7f04a860-0ed0-4a37-bbec-a8534b41b697 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7be61ae3-a9cd-4a68-8494-395f685ff6ee" status: 200 len: 1710 microversion: 2.20 time: 0.298015 Apr 19 08:11:11 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 120/358] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:11:11 2023] GET /compute/v2.1/servers/7be61ae3-a9cd-4a68-8494-395f685ff6ee => generated 1710 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 19 08:11:11 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-b51bc5e2-6de6-41a7-aff0-3cc32834842f req-bd548f09-2ed6-46c2-9763-2b619a99e26a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be61ae3-a9cd-4a68-8494-395f685ff6ee", "name": "network-vif-unplugged", "status": "completed", "tag": "3f2753b2-3728-4d4a-8238-f08e4d03e465"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:11:11 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-b51bc5e2-6de6-41a7-aff0-3cc32834842f req-bd548f09-2ed6-46c2-9763-2b619a99e26a service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:11:11 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-b51bc5e2-6de6-41a7-aff0-3cc32834842f req-bd548f09-2ed6-46c2-9763-2b619a99e26a service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:11:11 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-b51bc5e2-6de6-41a7-aff0-3cc32834842f req-bd548f09-2ed6-46c2-9763-2b619a99e26a service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:11:11 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-b51bc5e2-6de6-41a7-aff0-3cc32834842f req-bd548f09-2ed6-46c2-9763-2b619a99e26a service nova] Creating event network-vif-unplugged:3f2753b2-3728-4d4a-8238-f08e4d03e465 for instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee on user Apr 19 08:11:11 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-b51bc5e2-6de6-41a7-aff0-3cc32834842f req-bd548f09-2ed6-46c2-9763-2b619a99e26a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028282 Apr 19 08:11:11 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 122/359] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:11:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:11:12 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-fb150dd6-67cc-4fbc-87a6-ddb7f783929d req-a0a761d4-d826-454f-866e-b1373c013c33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be61ae3-a9cd-4a68-8494-395f685ff6ee", "name": "network-vif-deleted", "tag": "3f2753b2-3728-4d4a-8238-f08e4d03e465"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:11:13 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-fb150dd6-67cc-4fbc-87a6-ddb7f783929d req-a0a761d4-d826-454f-866e-b1373c013c33 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:11:13 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-fb150dd6-67cc-4fbc-87a6-ddb7f783929d req-a0a761d4-d826-454f-866e-b1373c013c33 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:11:13 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-fb150dd6-67cc-4fbc-87a6-ddb7f783929d req-a0a761d4-d826-454f-866e-b1373c013c33 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:11:13 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-fb150dd6-67cc-4fbc-87a6-ddb7f783929d req-a0a761d4-d826-454f-866e-b1373c013c33 service nova] Creating event network-vif-deleted:3f2753b2-3728-4d4a-8238-f08e4d03e465 for instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee on user Apr 19 08:11:13 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-fb150dd6-67cc-4fbc-87a6-ddb7f783929d req-a0a761d4-d826-454f-866e-b1373c013c33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030378 Apr 19 08:11:13 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 118/360] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:11:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:11:13 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-81e69828-5645-4512-ae9c-c8dd71032f90 req-dbfb2f8a-6c8e-4034-9f7c-1610da702e97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be61ae3-a9cd-4a68-8494-395f685ff6ee", "name": "network-vif-plugged", "status": "completed", "tag": "3f2753b2-3728-4d4a-8238-f08e4d03e465"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:11:13 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-81e69828-5645-4512-ae9c-c8dd71032f90 req-dbfb2f8a-6c8e-4034-9f7c-1610da702e97 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:11:13 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-81e69828-5645-4512-ae9c-c8dd71032f90 req-dbfb2f8a-6c8e-4034-9f7c-1610da702e97 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:11:13 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-81e69828-5645-4512-ae9c-c8dd71032f90 req-dbfb2f8a-6c8e-4034-9f7c-1610da702e97 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:11:13 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-81e69828-5645-4512-ae9c-c8dd71032f90 req-dbfb2f8a-6c8e-4034-9f7c-1610da702e97 service nova] Creating event network-vif-plugged:3f2753b2-3728-4d4a-8238-f08e4d03e465 for instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee on user Apr 19 08:11:13 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=4 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:11:13 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-81e69828-5645-4512-ae9c-c8dd71032f90 req-dbfb2f8a-6c8e-4034-9f7c-1610da702e97 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032028 Apr 19 08:11:13 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 121/361] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:11:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:11:23 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:11:23 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=6 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:11:23 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-6de8271c-2d7f-4d9a-92bc-bd700b74f3ab tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:11:23 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-6de8271c-2d7f-4d9a-92bc-bd700b74f3ab tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] [instance: 266d27ff-db1d-443a-8562-b67a859afe20] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:11:23 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6de8271c-2d7f-4d9a-92bc-bd700b74f3ab tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:11:23 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6de8271c-2d7f-4d9a-92bc-bd700b74f3ab tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:11:23 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6de8271c-2d7f-4d9a-92bc-bd700b74f3ab tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:11:23 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6de8271c-2d7f-4d9a-92bc-bd700b74f3ab tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:11:23 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6de8271c-2d7f-4d9a-92bc-bd700b74f3ab tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:11:23 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6de8271c-2d7f-4d9a-92bc-bd700b74f3ab tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:11:23 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-6de8271c-2d7f-4d9a-92bc-bd700b74f3ab tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2027c586717a407baa7cd8f3cdc56459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f98320d1745918cc7e2ca0ddf0ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:11:23 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-6de8271c-2d7f-4d9a-92bc-bd700b74f3ab tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/266d27ff-db1d-443a-8562-b67a859afe20" status: 200 len: 1493 microversion: 2.1 time: 0.662262 Apr 19 08:11:23 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 123/362] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:11:23 2023] GET /compute/v2.1/servers/266d27ff-db1d-443a-8562-b67a859afe20 => generated 1493 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:11:41 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:11:41 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:11:42 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-9fc763ed-0f1a-4fb9-9223-fa756e29b571 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-593074802"}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:11:42 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-9fc763ed-0f1a-4fb9-9223-fa756e29b571 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 092ebf79-b95c-460d-8f90-28d4e4a7ce7e] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:11:42 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-9fc763ed-0f1a-4fb9-9223-fa756e29b571 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:11:42 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-9fc763ed-0f1a-4fb9-9223-fa756e29b571 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:11:42 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-9fc763ed-0f1a-4fb9-9223-fa756e29b571 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:11:42 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-9fc763ed-0f1a-4fb9-9223-fa756e29b571 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:11:42 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-9fc763ed-0f1a-4fb9-9223-fa756e29b571 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:11:42 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-9fc763ed-0f1a-4fb9-9223-fa756e29b571 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:11:43 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-9fc763ed-0f1a-4fb9-9223-fa756e29b571 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "POST /compute/v2.1/servers/092ebf79-b95c-460d-8f90-28d4e4a7ce7e/action" status: 202 len: 52 microversion: 2.87 time: 1.130885 Apr 19 08:11:43 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 119/363] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 19 08:11:41 2023] POST /compute/v2.1/servers/092ebf79-b95c-460d-8f90-28d4e4a7ce7e/action => generated 52 bytes in 1133 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 19 08:11:48 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:11:48 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=10 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:11:48 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-20f187c6-46c6-49ff-a8a3-8fa5470ae344 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:11:48 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-20f187c6-46c6-49ff-a8a3-8fa5470ae344 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 092ebf79-b95c-460d-8f90-28d4e4a7ce7e] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:11:48 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-20f187c6-46c6-49ff-a8a3-8fa5470ae344 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:11:48 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-20f187c6-46c6-49ff-a8a3-8fa5470ae344 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:11:48 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-20f187c6-46c6-49ff-a8a3-8fa5470ae344 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:11:48 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-20f187c6-46c6-49ff-a8a3-8fa5470ae344 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:11:48 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-20f187c6-46c6-49ff-a8a3-8fa5470ae344 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:11:48 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-20f187c6-46c6-49ff-a8a3-8fa5470ae344 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:11:48 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-20f187c6-46c6-49ff-a8a3-8fa5470ae344 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:11:48 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-20f187c6-46c6-49ff-a8a3-8fa5470ae344 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:11:48 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-20f187c6-46c6-49ff-a8a3-8fa5470ae344 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:11:48 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-20f187c6-46c6-49ff-a8a3-8fa5470ae344 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/092ebf79-b95c-460d-8f90-28d4e4a7ce7e" status: 200 len: 1691 microversion: 2.87 time: 0.283845 Apr 19 08:11:48 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 122/364] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:11:48 2023] GET /compute/v2.1/servers/092ebf79-b95c-460d-8f90-28d4e4a7ce7e => generated 1691 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 08:12:01 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=2 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:12:01 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=6 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:12:01 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-6c34fa3b-bbba-464b-a21f-46a1dc59caba tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:12:01 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-6c34fa3b-bbba-464b-a21f-46a1dc59caba tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] [instance: 7be61ae3-a9cd-4a68-8494-395f685ff6ee] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:12:01 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6c34fa3b-bbba-464b-a21f-46a1dc59caba tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:12:01 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6c34fa3b-bbba-464b-a21f-46a1dc59caba tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:12:01 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6c34fa3b-bbba-464b-a21f-46a1dc59caba tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:12:01 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6c34fa3b-bbba-464b-a21f-46a1dc59caba tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:12:01 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6c34fa3b-bbba-464b-a21f-46a1dc59caba tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:12:01 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-6c34fa3b-bbba-464b-a21f-46a1dc59caba tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:12:01 user devstack@n-api.service[61210]: INFO nova.api.openstack.wsgi [None req-6c34fa3b-bbba-464b-a21f-46a1dc59caba tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] HTTP exception thrown: Instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee could not be found. Apr 19 08:12:01 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-6c34fa3b-bbba-464b-a21f-46a1dc59caba tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Request method failure captured: Apr 19 08:12:01 user devstack@n-api.service[61210]: request: GET /compute/v2.1/servers/7be61ae3-a9cd-4a68-8494-395f685ff6ee HTTP/1.1 Apr 19 08:12:01 user devstack@n-api.service[61210]: Accept: application/json Apr 19 08:12:01 user devstack@n-api.service[61210]: Accept-Encoding: identity Apr 19 08:12:01 user devstack@n-api.service[61210]: Connection: close Apr 19 08:12:01 user devstack@n-api.service[61210]: Content-Length: 0 Apr 19 08:12:01 user devstack@n-api.service[61210]: Content-Type: application/json Apr 19 08:12:01 user devstack@n-api.service[61210]: Host: 10.0.0.210 Apr 19 08:12:01 user devstack@n-api.service[61210]: Openstack-System-Scope: None Apr 19 08:12:01 user devstack@n-api.service[61210]: User-Agent: python-urllib3/1.26.15 Apr 19 08:12:01 user devstack@n-api.service[61210]: X-Auth-Token: gAAAAABkP6EEy1tc3_nQGep4bEpMFqh5uA59YicJp0vv0TPYgBhmcE3rIw02B_W-J3gKcT0_ijrOgU0QhTzYvN24TTP91Em23hZn7bKet4PXoX6Rq6iur5mfEGZtIE5FNz1wI2LGa8agXuosZRbbJi6Cda0ne5t9hwW-pubpM70Eiac8UkNw0nM Apr 19 08:12:01 user devstack@n-api.service[61210]: X-Domain-Id: None Apr 19 08:12:01 user devstack@n-api.service[61210]: X-Domain-Name: None Apr 19 08:12:01 user devstack@n-api.service[61210]: X-Identity-Status: Confirmed Apr 19 08:12:01 user devstack@n-api.service[61210]: X-Is-Admin-Project: True Apr 19 08:12:01 user devstack@n-api.service[61210]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 08:12:01 user devstack@n-api.service[61210]: X-Project-Domain-Id: default Apr 19 08:12:01 user devstack@n-api.service[61210]: X-Project-Domain-Name: Default Apr 19 08:12:01 user devstack@n-api.service[61210]: X-Project-Id: f475ef63d11f4decbd33dfc63e108d12 Apr 19 08:12:01 user devstack@n-api.service[61210]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-459720759 Apr 19 08:12:01 user devstack@n-api.service[61210]: X-Role: reader,member Apr 19 08:12:01 user devstack@n-api.service[61210]: X-Roles: reader,member Apr 19 08:12:01 user devstack@n-api.service[61210]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f475ef63d11f4decbd33dfc63e108d12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f475ef63d11f4decbd33dfc63e108d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f475ef63d11f4decbd33dfc63e108d12"}]}] Apr 19 08:12:01 user devstack@n-api.service[61210]: X-Tenant: tempest-AttachVolumeShelveTestJSON-459720759 Apr 19 08:12:01 user devstack@n-api.service[61210]: X-Tenant-Id: f475ef63d11f4decbd33dfc63e108d12 Apr 19 08:12:01 user devstack@n-api.service[61210]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-459720759 Apr 19 08:12:01 user devstack@n-api.service[61210]: X-User: tempest-AttachVolumeShelveTestJSON-459720759-project-member Apr 19 08:12:01 user devstack@n-api.service[61210]: X-User-Domain-Id: default Apr 19 08:12:01 user devstack@n-api.service[61210]: X-User-Domain-Name: Default Apr 19 08:12:01 user devstack@n-api.service[61210]: X-User-Id: a0d79080dd7b4e20932eb3774bdc97a4 Apr 19 08:12:01 user devstack@n-api.service[61210]: X-User-Name: tempest-AttachVolumeShelveTestJSON-459720759-project-member Apr 19 08:12:01 user devstack@n-api.service[61210]: method: > Apr 19 08:12:01 user devstack@n-api.service[61210]: exception: Instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee could not be found. Apr 19 08:12:01 user devstack@n-api.service[61210]: action_args: {'id': '7be61ae3-a9cd-4a68-8494-395f685ff6ee'} Apr 19 08:12:01 user devstack@n-api.service[61210]: {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee could not be found. Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee could not be found. Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee could not be found. Apr 19 08:12:01 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:12:01 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-6c34fa3b-bbba-464b-a21f-46a1dc59caba tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Returning 404 to user: Instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee could not be found. {{(pid=61210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:12:01 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-6c34fa3b-bbba-464b-a21f-46a1dc59caba tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7be61ae3-a9cd-4a68-8494-395f685ff6ee" status: 404 len: 111 microversion: 2.20 time: 0.268564 Apr 19 08:12:01 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 124/365] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:12:01 2023] GET /compute/v2.1/servers/7be61ae3-a9cd-4a68-8494-395f685ff6ee => generated 111 bytes in 270 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 08:12:01 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:12:01 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:12:01 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-c1cb8480-225a-409e-9d68-b9ee0bc46994 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Calling method '.version_select at 0x7f2c010cd480>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:12:01 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-c1cb8480-225a-409e-9d68-b9ee0bc46994 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-810739864" status: 204 len: 0 microversion: 2.20 time: 0.027078 Apr 19 08:12:01 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 120/366] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 19 08:12:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-810739864 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 08:12:02 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-9d90dca7-aabd-4877-9bd9-04b2f0a311cc tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:12:02 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-9d90dca7-aabd-4877-9bd9-04b2f0a311cc tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] [instance: 7be61ae3-a9cd-4a68-8494-395f685ff6ee] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:12:02 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=6 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:12:02 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=4 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:12:02 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-9d90dca7-aabd-4877-9bd9-04b2f0a311cc tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:12:02 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-9d90dca7-aabd-4877-9bd9-04b2f0a311cc tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:12:02 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-9d90dca7-aabd-4877-9bd9-04b2f0a311cc tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:12:02 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-9d90dca7-aabd-4877-9bd9-04b2f0a311cc tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:12:02 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-9d90dca7-aabd-4877-9bd9-04b2f0a311cc tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:12:02 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-9d90dca7-aabd-4877-9bd9-04b2f0a311cc tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:12:02 user devstack@n-api.service[61208]: INFO nova.api.openstack.wsgi [None req-9d90dca7-aabd-4877-9bd9-04b2f0a311cc tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] HTTP exception thrown: Instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee could not be found. Apr 19 08:12:02 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-9d90dca7-aabd-4877-9bd9-04b2f0a311cc tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Request method failure captured: Apr 19 08:12:02 user devstack@n-api.service[61208]: request: DELETE /compute/v2.1/servers/7be61ae3-a9cd-4a68-8494-395f685ff6ee HTTP/1.1 Apr 19 08:12:02 user devstack@n-api.service[61208]: Accept: application/json Apr 19 08:12:02 user devstack@n-api.service[61208]: Accept-Encoding: identity Apr 19 08:12:02 user devstack@n-api.service[61208]: Connection: close Apr 19 08:12:02 user devstack@n-api.service[61208]: Content-Length: 0 Apr 19 08:12:02 user devstack@n-api.service[61208]: Content-Type: application/json Apr 19 08:12:02 user devstack@n-api.service[61208]: Host: 10.0.0.210 Apr 19 08:12:02 user devstack@n-api.service[61208]: Openstack-System-Scope: None Apr 19 08:12:02 user devstack@n-api.service[61208]: User-Agent: python-urllib3/1.26.15 Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Auth-Token: gAAAAABkP6EEy1tc3_nQGep4bEpMFqh5uA59YicJp0vv0TPYgBhmcE3rIw02B_W-J3gKcT0_ijrOgU0QhTzYvN24TTP91Em23hZn7bKet4PXoX6Rq6iur5mfEGZtIE5FNz1wI2LGa8agXuosZRbbJi6Cda0ne5t9hwW-pubpM70Eiac8UkNw0nM Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Domain-Id: None Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Domain-Name: None Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Identity-Status: Confirmed Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Is-Admin-Project: True Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Project-Domain-Id: default Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Project-Domain-Name: Default Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Project-Id: f475ef63d11f4decbd33dfc63e108d12 Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-459720759 Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Role: reader,member Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Roles: reader,member Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f475ef63d11f4decbd33dfc63e108d12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f475ef63d11f4decbd33dfc63e108d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f475ef63d11f4decbd33dfc63e108d12"}]}] Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Tenant: tempest-AttachVolumeShelveTestJSON-459720759 Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Tenant-Id: f475ef63d11f4decbd33dfc63e108d12 Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-459720759 Apr 19 08:12:02 user devstack@n-api.service[61208]: X-User: tempest-AttachVolumeShelveTestJSON-459720759-project-member Apr 19 08:12:02 user devstack@n-api.service[61208]: X-User-Domain-Id: default Apr 19 08:12:02 user devstack@n-api.service[61208]: X-User-Domain-Name: Default Apr 19 08:12:02 user devstack@n-api.service[61208]: X-User-Id: a0d79080dd7b4e20932eb3774bdc97a4 Apr 19 08:12:02 user devstack@n-api.service[61208]: X-User-Name: tempest-AttachVolumeShelveTestJSON-459720759-project-member Apr 19 08:12:02 user devstack@n-api.service[61208]: method: > Apr 19 08:12:02 user devstack@n-api.service[61208]: exception: Instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee could not be found. Apr 19 08:12:02 user devstack@n-api.service[61208]: action_args: {'id': '7be61ae3-a9cd-4a68-8494-395f685ff6ee'} Apr 19 08:12:02 user devstack@n-api.service[61208]: {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee could not be found. Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee could not be found. Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee could not be found. Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:12:02 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-9d90dca7-aabd-4877-9bd9-04b2f0a311cc tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Returning 404 to user: Instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee could not be found. {{(pid=61208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:12:02 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-9d90dca7-aabd-4877-9bd9-04b2f0a311cc tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7be61ae3-a9cd-4a68-8494-395f685ff6ee" status: 404 len: 111 microversion: 2.20 time: 0.030368 Apr 19 08:12:02 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 123/367] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 08:12:02 2023] DELETE /compute/v2.1/servers/7be61ae3-a9cd-4a68-8494-395f685ff6ee => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 08:12:02 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-7d287132-dae6-4c3b-a1f7-7034233da402 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:12:02 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-7d287132-dae6-4c3b-a1f7-7034233da402 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] [instance: 7be61ae3-a9cd-4a68-8494-395f685ff6ee] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:12:02 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-7d287132-dae6-4c3b-a1f7-7034233da402 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:12:02 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-7d287132-dae6-4c3b-a1f7-7034233da402 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:12:02 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-7d287132-dae6-4c3b-a1f7-7034233da402 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:12:02 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-7d287132-dae6-4c3b-a1f7-7034233da402 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:12:02 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-7d287132-dae6-4c3b-a1f7-7034233da402 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:12:02 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-7d287132-dae6-4c3b-a1f7-7034233da402 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:12:02 user devstack@n-api.service[61210]: INFO nova.api.openstack.wsgi [None req-7d287132-dae6-4c3b-a1f7-7034233da402 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] HTTP exception thrown: Instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee could not be found. Apr 19 08:12:02 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-7d287132-dae6-4c3b-a1f7-7034233da402 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Request method failure captured: Apr 19 08:12:02 user devstack@n-api.service[61210]: request: GET /compute/v2.1/servers/7be61ae3-a9cd-4a68-8494-395f685ff6ee HTTP/1.1 Apr 19 08:12:02 user devstack@n-api.service[61210]: Accept: application/json Apr 19 08:12:02 user devstack@n-api.service[61210]: Accept-Encoding: identity Apr 19 08:12:02 user devstack@n-api.service[61210]: Connection: close Apr 19 08:12:02 user devstack@n-api.service[61210]: Content-Length: 0 Apr 19 08:12:02 user devstack@n-api.service[61210]: Content-Type: application/json Apr 19 08:12:02 user devstack@n-api.service[61210]: Host: 10.0.0.210 Apr 19 08:12:02 user devstack@n-api.service[61210]: Openstack-System-Scope: None Apr 19 08:12:02 user devstack@n-api.service[61210]: User-Agent: python-urllib3/1.26.15 Apr 19 08:12:02 user devstack@n-api.service[61210]: X-Auth-Token: gAAAAABkP6EEy1tc3_nQGep4bEpMFqh5uA59YicJp0vv0TPYgBhmcE3rIw02B_W-J3gKcT0_ijrOgU0QhTzYvN24TTP91Em23hZn7bKet4PXoX6Rq6iur5mfEGZtIE5FNz1wI2LGa8agXuosZRbbJi6Cda0ne5t9hwW-pubpM70Eiac8UkNw0nM Apr 19 08:12:02 user devstack@n-api.service[61210]: X-Domain-Id: None Apr 19 08:12:02 user devstack@n-api.service[61210]: X-Domain-Name: None Apr 19 08:12:02 user devstack@n-api.service[61210]: X-Identity-Status: Confirmed Apr 19 08:12:02 user devstack@n-api.service[61210]: X-Is-Admin-Project: True Apr 19 08:12:02 user devstack@n-api.service[61210]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 08:12:02 user devstack@n-api.service[61210]: X-Project-Domain-Id: default Apr 19 08:12:02 user devstack@n-api.service[61210]: X-Project-Domain-Name: Default Apr 19 08:12:02 user devstack@n-api.service[61210]: X-Project-Id: f475ef63d11f4decbd33dfc63e108d12 Apr 19 08:12:02 user devstack@n-api.service[61210]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-459720759 Apr 19 08:12:02 user devstack@n-api.service[61210]: X-Role: reader,member Apr 19 08:12:02 user devstack@n-api.service[61210]: X-Roles: reader,member Apr 19 08:12:02 user devstack@n-api.service[61210]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f475ef63d11f4decbd33dfc63e108d12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f475ef63d11f4decbd33dfc63e108d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f475ef63d11f4decbd33dfc63e108d12"}]}] Apr 19 08:12:02 user devstack@n-api.service[61210]: X-Tenant: tempest-AttachVolumeShelveTestJSON-459720759 Apr 19 08:12:02 user devstack@n-api.service[61210]: X-Tenant-Id: f475ef63d11f4decbd33dfc63e108d12 Apr 19 08:12:02 user devstack@n-api.service[61210]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-459720759 Apr 19 08:12:02 user devstack@n-api.service[61210]: X-User: tempest-AttachVolumeShelveTestJSON-459720759-project-member Apr 19 08:12:02 user devstack@n-api.service[61210]: X-User-Domain-Id: default Apr 19 08:12:02 user devstack@n-api.service[61210]: X-User-Domain-Name: Default Apr 19 08:12:02 user devstack@n-api.service[61210]: X-User-Id: a0d79080dd7b4e20932eb3774bdc97a4 Apr 19 08:12:02 user devstack@n-api.service[61210]: X-User-Name: tempest-AttachVolumeShelveTestJSON-459720759-project-member Apr 19 08:12:02 user devstack@n-api.service[61210]: method: > Apr 19 08:12:02 user devstack@n-api.service[61210]: exception: Instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee could not be found. Apr 19 08:12:02 user devstack@n-api.service[61210]: action_args: {'id': '7be61ae3-a9cd-4a68-8494-395f685ff6ee'} Apr 19 08:12:02 user devstack@n-api.service[61210]: {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee could not be found. Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee could not be found. Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee could not be found. Apr 19 08:12:02 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:12:02 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-7d287132-dae6-4c3b-a1f7-7034233da402 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Returning 404 to user: Instance 7be61ae3-a9cd-4a68-8494-395f685ff6ee could not be found. {{(pid=61210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:12:02 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-7d287132-dae6-4c3b-a1f7-7034233da402 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7be61ae3-a9cd-4a68-8494-395f685ff6ee" status: 404 len: 111 microversion: 2.20 time: 0.026515 Apr 19 08:12:02 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 125/368] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:12:02 2023] GET /compute/v2.1/servers/7be61ae3-a9cd-4a68-8494-395f685ff6ee => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 08:12:02 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-d75a13c9-cf7f-4fd9-9eac-d6120a7ab2cd tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:12:02 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-d75a13c9-cf7f-4fd9-9eac-d6120a7ab2cd tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] [instance: 45c79c22-b7be-444f-8d5a-f152377c70f3] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:12:02 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d75a13c9-cf7f-4fd9-9eac-d6120a7ab2cd tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:12:02 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d75a13c9-cf7f-4fd9-9eac-d6120a7ab2cd tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:12:02 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d75a13c9-cf7f-4fd9-9eac-d6120a7ab2cd tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:12:02 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d75a13c9-cf7f-4fd9-9eac-d6120a7ab2cd tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:12:02 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d75a13c9-cf7f-4fd9-9eac-d6120a7ab2cd tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:12:02 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d75a13c9-cf7f-4fd9-9eac-d6120a7ab2cd tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:12:02 user devstack@n-api.service[61209]: INFO nova.api.openstack.wsgi [None req-d75a13c9-cf7f-4fd9-9eac-d6120a7ab2cd tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] HTTP exception thrown: Instance 45c79c22-b7be-444f-8d5a-f152377c70f3 could not be found. Apr 19 08:12:02 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-d75a13c9-cf7f-4fd9-9eac-d6120a7ab2cd tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Request method failure captured: Apr 19 08:12:02 user devstack@n-api.service[61209]: request: DELETE /compute/v2.1/servers/45c79c22-b7be-444f-8d5a-f152377c70f3 HTTP/1.1 Apr 19 08:12:02 user devstack@n-api.service[61209]: Accept: application/json Apr 19 08:12:02 user devstack@n-api.service[61209]: Accept-Encoding: identity Apr 19 08:12:02 user devstack@n-api.service[61209]: Connection: close Apr 19 08:12:02 user devstack@n-api.service[61209]: Content-Length: 0 Apr 19 08:12:02 user devstack@n-api.service[61209]: Content-Type: application/json Apr 19 08:12:02 user devstack@n-api.service[61209]: Host: 10.0.0.210 Apr 19 08:12:02 user devstack@n-api.service[61209]: Openstack-System-Scope: None Apr 19 08:12:02 user devstack@n-api.service[61209]: User-Agent: python-urllib3/1.26.15 Apr 19 08:12:02 user devstack@n-api.service[61209]: X-Auth-Token: gAAAAABkP6EEy1tc3_nQGep4bEpMFqh5uA59YicJp0vv0TPYgBhmcE3rIw02B_W-J3gKcT0_ijrOgU0QhTzYvN24TTP91Em23hZn7bKet4PXoX6Rq6iur5mfEGZtIE5FNz1wI2LGa8agXuosZRbbJi6Cda0ne5t9hwW-pubpM70Eiac8UkNw0nM Apr 19 08:12:02 user devstack@n-api.service[61209]: X-Domain-Id: None Apr 19 08:12:02 user devstack@n-api.service[61209]: X-Domain-Name: None Apr 19 08:12:02 user devstack@n-api.service[61209]: X-Identity-Status: Confirmed Apr 19 08:12:02 user devstack@n-api.service[61209]: X-Is-Admin-Project: True Apr 19 08:12:02 user devstack@n-api.service[61209]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 08:12:02 user devstack@n-api.service[61209]: X-Project-Domain-Id: default Apr 19 08:12:02 user devstack@n-api.service[61209]: X-Project-Domain-Name: Default Apr 19 08:12:02 user devstack@n-api.service[61209]: X-Project-Id: f475ef63d11f4decbd33dfc63e108d12 Apr 19 08:12:02 user devstack@n-api.service[61209]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-459720759 Apr 19 08:12:02 user devstack@n-api.service[61209]: X-Role: reader,member Apr 19 08:12:02 user devstack@n-api.service[61209]: X-Roles: reader,member Apr 19 08:12:02 user devstack@n-api.service[61209]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f475ef63d11f4decbd33dfc63e108d12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f475ef63d11f4decbd33dfc63e108d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f475ef63d11f4decbd33dfc63e108d12"}]}] Apr 19 08:12:02 user devstack@n-api.service[61209]: X-Tenant: tempest-AttachVolumeShelveTestJSON-459720759 Apr 19 08:12:02 user devstack@n-api.service[61209]: X-Tenant-Id: f475ef63d11f4decbd33dfc63e108d12 Apr 19 08:12:02 user devstack@n-api.service[61209]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-459720759 Apr 19 08:12:02 user devstack@n-api.service[61209]: X-User: tempest-AttachVolumeShelveTestJSON-459720759-project-member Apr 19 08:12:02 user devstack@n-api.service[61209]: X-User-Domain-Id: default Apr 19 08:12:02 user devstack@n-api.service[61209]: X-User-Domain-Name: Default Apr 19 08:12:02 user devstack@n-api.service[61209]: X-User-Id: a0d79080dd7b4e20932eb3774bdc97a4 Apr 19 08:12:02 user devstack@n-api.service[61209]: X-User-Name: tempest-AttachVolumeShelveTestJSON-459720759-project-member Apr 19 08:12:02 user devstack@n-api.service[61209]: method: > Apr 19 08:12:02 user devstack@n-api.service[61209]: exception: Instance 45c79c22-b7be-444f-8d5a-f152377c70f3 could not be found. Apr 19 08:12:02 user devstack@n-api.service[61209]: action_args: {'id': '45c79c22-b7be-444f-8d5a-f152377c70f3'} Apr 19 08:12:02 user devstack@n-api.service[61209]: {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45c79c22-b7be-444f-8d5a-f152377c70f3 could not be found. Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45c79c22-b7be-444f-8d5a-f152377c70f3 could not be found. Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45c79c22-b7be-444f-8d5a-f152377c70f3 could not be found. Apr 19 08:12:02 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:12:02 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-d75a13c9-cf7f-4fd9-9eac-d6120a7ab2cd tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Returning 404 to user: Instance 45c79c22-b7be-444f-8d5a-f152377c70f3 could not be found. {{(pid=61209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:12:02 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-d75a13c9-cf7f-4fd9-9eac-d6120a7ab2cd tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/45c79c22-b7be-444f-8d5a-f152377c70f3" status: 404 len: 111 microversion: 2.20 time: 0.053203 Apr 19 08:12:02 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 121/369] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 08:12:02 2023] DELETE /compute/v2.1/servers/45c79c22-b7be-444f-8d5a-f152377c70f3 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 08:12:02 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-3a023b6e-1df8-4e73-96c4-991dc18184c7 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:12:02 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-3a023b6e-1df8-4e73-96c4-991dc18184c7 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] [instance: 45c79c22-b7be-444f-8d5a-f152377c70f3] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:12:02 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-3a023b6e-1df8-4e73-96c4-991dc18184c7 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:12:02 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-3a023b6e-1df8-4e73-96c4-991dc18184c7 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:12:02 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-3a023b6e-1df8-4e73-96c4-991dc18184c7 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:12:02 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-3a023b6e-1df8-4e73-96c4-991dc18184c7 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:12:02 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-3a023b6e-1df8-4e73-96c4-991dc18184c7 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:12:02 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-3a023b6e-1df8-4e73-96c4-991dc18184c7 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:12:02 user devstack@n-api.service[61208]: INFO nova.api.openstack.wsgi [None req-3a023b6e-1df8-4e73-96c4-991dc18184c7 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] HTTP exception thrown: Instance 45c79c22-b7be-444f-8d5a-f152377c70f3 could not be found. Apr 19 08:12:02 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-3a023b6e-1df8-4e73-96c4-991dc18184c7 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Request method failure captured: Apr 19 08:12:02 user devstack@n-api.service[61208]: request: GET /compute/v2.1/servers/45c79c22-b7be-444f-8d5a-f152377c70f3 HTTP/1.1 Apr 19 08:12:02 user devstack@n-api.service[61208]: Accept: application/json Apr 19 08:12:02 user devstack@n-api.service[61208]: Accept-Encoding: identity Apr 19 08:12:02 user devstack@n-api.service[61208]: Connection: close Apr 19 08:12:02 user devstack@n-api.service[61208]: Content-Length: 0 Apr 19 08:12:02 user devstack@n-api.service[61208]: Content-Type: application/json Apr 19 08:12:02 user devstack@n-api.service[61208]: Host: 10.0.0.210 Apr 19 08:12:02 user devstack@n-api.service[61208]: Openstack-System-Scope: None Apr 19 08:12:02 user devstack@n-api.service[61208]: User-Agent: python-urllib3/1.26.15 Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Auth-Token: gAAAAABkP6EEy1tc3_nQGep4bEpMFqh5uA59YicJp0vv0TPYgBhmcE3rIw02B_W-J3gKcT0_ijrOgU0QhTzYvN24TTP91Em23hZn7bKet4PXoX6Rq6iur5mfEGZtIE5FNz1wI2LGa8agXuosZRbbJi6Cda0ne5t9hwW-pubpM70Eiac8UkNw0nM Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Domain-Id: None Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Domain-Name: None Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Identity-Status: Confirmed Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Is-Admin-Project: True Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Openstack-Nova-Api-Version: 2.20 Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Project-Domain-Id: default Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Project-Domain-Name: Default Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Project-Id: f475ef63d11f4decbd33dfc63e108d12 Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-459720759 Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Role: reader,member Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Roles: reader,member Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f475ef63d11f4decbd33dfc63e108d12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f475ef63d11f4decbd33dfc63e108d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f475ef63d11f4decbd33dfc63e108d12"}]}] Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Tenant: tempest-AttachVolumeShelveTestJSON-459720759 Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Tenant-Id: f475ef63d11f4decbd33dfc63e108d12 Apr 19 08:12:02 user devstack@n-api.service[61208]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-459720759 Apr 19 08:12:02 user devstack@n-api.service[61208]: X-User: tempest-AttachVolumeShelveTestJSON-459720759-project-member Apr 19 08:12:02 user devstack@n-api.service[61208]: X-User-Domain-Id: default Apr 19 08:12:02 user devstack@n-api.service[61208]: X-User-Domain-Name: Default Apr 19 08:12:02 user devstack@n-api.service[61208]: X-User-Id: a0d79080dd7b4e20932eb3774bdc97a4 Apr 19 08:12:02 user devstack@n-api.service[61208]: X-User-Name: tempest-AttachVolumeShelveTestJSON-459720759-project-member Apr 19 08:12:02 user devstack@n-api.service[61208]: method: > Apr 19 08:12:02 user devstack@n-api.service[61208]: exception: Instance 45c79c22-b7be-444f-8d5a-f152377c70f3 could not be found. Apr 19 08:12:02 user devstack@n-api.service[61208]: action_args: {'id': '45c79c22-b7be-444f-8d5a-f152377c70f3'} Apr 19 08:12:02 user devstack@n-api.service[61208]: {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45c79c22-b7be-444f-8d5a-f152377c70f3 could not be found. Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45c79c22-b7be-444f-8d5a-f152377c70f3 could not be found. Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45c79c22-b7be-444f-8d5a-f152377c70f3 could not be found. Apr 19 08:12:02 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:12:02 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-3a023b6e-1df8-4e73-96c4-991dc18184c7 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] Returning 404 to user: Instance 45c79c22-b7be-444f-8d5a-f152377c70f3 could not be found. {{(pid=61208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:12:02 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-3a023b6e-1df8-4e73-96c4-991dc18184c7 tempest-AttachVolumeShelveTestJSON-459720759 tempest-AttachVolumeShelveTestJSON-459720759-project-member] 10.0.0.210 "GET /compute/v2.1/servers/45c79c22-b7be-444f-8d5a-f152377c70f3" status: 404 len: 111 microversion: 2.20 time: 0.029301 Apr 19 08:12:02 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 124/370] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:12:02 2023] GET /compute/v2.1/servers/45c79c22-b7be-444f-8d5a-f152377c70f3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 08:12:25 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-050dccc6-b0e4-4aef-9d83-7b074e8c95e5 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:12:25 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-050dccc6-b0e4-4aef-9d83-7b074e8c95e5 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] [instance: 266d27ff-db1d-443a-8562-b67a859afe20] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:12:25 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=4 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:12:25 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=4 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:12:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-050dccc6-b0e4-4aef-9d83-7b074e8c95e5 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:12:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-050dccc6-b0e4-4aef-9d83-7b074e8c95e5 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:12:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-050dccc6-b0e4-4aef-9d83-7b074e8c95e5 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:12:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-050dccc6-b0e4-4aef-9d83-7b074e8c95e5 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:12:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-050dccc6-b0e4-4aef-9d83-7b074e8c95e5 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:12:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-050dccc6-b0e4-4aef-9d83-7b074e8c95e5 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:12:25 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-050dccc6-b0e4-4aef-9d83-7b074e8c95e5 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2027c586717a407baa7cd8f3cdc56459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f98320d1745918cc7e2ca0ddf0ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:12:25 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-050dccc6-b0e4-4aef-9d83-7b074e8c95e5 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/266d27ff-db1d-443a-8562-b67a859afe20" status: 200 len: 1493 microversion: 2.1 time: 0.285206 Apr 19 08:12:25 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 126/371] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:12:25 2023] GET /compute/v2.1/servers/266d27ff-db1d-443a-8562-b67a859afe20 => generated 1493 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:12:48 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-673b832a-6aba-4e2b-a3a6-e1ac8d30cc02 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1745815557", "imageRef": "b515545f-3b22-4d80-a102-6a318ab9717a", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "b515545f-3b22-4d80-a102-6a318ab9717a", "destination_type": "volume"}], "networks": [{"uuid": "c200dc82-8f76-41a5-8f0d-25b3fdcf2132"}]}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:12:48 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:12:48 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:12:48 user devstack@n-api.service[61209]: DEBUG nova.network.neutron [None req-673b832a-6aba-4e2b-a3a6-e1ac8d30cc02 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] validate_networks() for [('c200dc82-8f76-41a5-8f0d-25b3fdcf2132', None, None, None, None, None)] {{(pid=61209) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 08:12:49 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-673b832a-6aba-4e2b-a3a6-e1ac8d30cc02 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Flavor limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 08:12:49 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-673b832a-6aba-4e2b-a3a6-e1ac8d30cc02 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Image limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 08:12:49 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-673b832a-6aba-4e2b-a3a6-e1ac8d30cc02 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Flavor pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 08:12:49 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-673b832a-6aba-4e2b-a3a6-e1ac8d30cc02 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Image pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 08:12:49 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-673b832a-6aba-4e2b-a3a6-e1ac8d30cc02 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 08:12:49 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-673b832a-6aba-4e2b-a3a6-e1ac8d30cc02 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:12:49 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-673b832a-6aba-4e2b-a3a6-e1ac8d30cc02 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:12:49 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-673b832a-6aba-4e2b-a3a6-e1ac8d30cc02 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:12:49 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-673b832a-6aba-4e2b-a3a6-e1ac8d30cc02 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:12:49 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-673b832a-6aba-4e2b-a3a6-e1ac8d30cc02 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:12:49 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-673b832a-6aba-4e2b-a3a6-e1ac8d30cc02 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:12:49 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-673b832a-6aba-4e2b-a3a6-e1ac8d30cc02 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Getting quotas for project 7973fa0075de42e9a74627ae9cd98d9f. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:12:49 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-673b832a-6aba-4e2b-a3a6-e1ac8d30cc02 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Getting quotas for user 5530f99504de4426ba41cfa691c430c0 and project 7973fa0075de42e9a74627ae9cd98d9f. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:12:49 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-673b832a-6aba-4e2b-a3a6-e1ac8d30cc02 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Going to run 1 instances... {{(pid=61209) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 08:12:49 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-673b832a-6aba-4e2b-a3a6-e1ac8d30cc02 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: d41f0acf-e06f-4837-b910-021570fa41ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b515545f-3b22-4d80-a102-6a318ab9717a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 08:12:49 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-673b832a-6aba-4e2b-a3a6-e1ac8d30cc02 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.877148 Apr 19 08:12:49 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 122/372] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 19 08:12:48 2023] POST /compute/v2.1/servers => generated 378 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 19 08:12:49 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-0463096a-118d-47ba-8230-4cdc09f8e085 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:12:49 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-0463096a-118d-47ba-8230-4cdc09f8e085 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: d41f0acf-e06f-4837-b910-021570fa41ec] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:12:49 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=4 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:12:49 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=4 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:12:49 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-0463096a-118d-47ba-8230-4cdc09f8e085 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:12:49 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-0463096a-118d-47ba-8230-4cdc09f8e085 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:12:49 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-0463096a-118d-47ba-8230-4cdc09f8e085 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:12:49 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-0463096a-118d-47ba-8230-4cdc09f8e085 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d41f0acf-e06f-4837-b910-021570fa41ec" status: 200 len: 1395 microversion: 2.87 time: 0.079692 Apr 19 08:12:49 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 125/373] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:12:49 2023] GET /compute/v2.1/servers/d41f0acf-e06f-4837-b910-021570fa41ec => generated 1395 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 08:12:52 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-a10be6c8-9d68-4b71-83a2-2dd630b38f74 req-7018c16e-0ccf-418c-8aa0-a5ffe42ef132 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d41f0acf-e06f-4837-b910-021570fa41ec", "tag": "6bb4360e-5838-4278-a70d-9dc8741295a8"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:12:52 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=2 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:12:52 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=6 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:12:52 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-a10be6c8-9d68-4b71-83a2-2dd630b38f74 req-7018c16e-0ccf-418c-8aa0-a5ffe42ef132 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:12:52 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-a10be6c8-9d68-4b71-83a2-2dd630b38f74 req-7018c16e-0ccf-418c-8aa0-a5ffe42ef132 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:12:52 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-a10be6c8-9d68-4b71-83a2-2dd630b38f74 req-7018c16e-0ccf-418c-8aa0-a5ffe42ef132 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:12:52 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-a10be6c8-9d68-4b71-83a2-2dd630b38f74 req-7018c16e-0ccf-418c-8aa0-a5ffe42ef132 service nova] Creating event network-changed:6bb4360e-5838-4278-a70d-9dc8741295a8 for instance d41f0acf-e06f-4837-b910-021570fa41ec on user Apr 19 08:12:52 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-a10be6c8-9d68-4b71-83a2-2dd630b38f74 req-7018c16e-0ccf-418c-8aa0-a5ffe42ef132 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032876 Apr 19 08:12:52 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 127/374] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:12:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:12:56 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-cfdfce09-6111-4ca6-926e-c95221654080 req-0d8b6899-3c2f-445e-be6d-a1d053a1a507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d41f0acf-e06f-4837-b910-021570fa41ec", "name": "network-vif-deleted", "tag": "6bb4360e-5838-4278-a70d-9dc8741295a8"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:12:56 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-cfdfce09-6111-4ca6-926e-c95221654080 req-0d8b6899-3c2f-445e-be6d-a1d053a1a507 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:12:56 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-cfdfce09-6111-4ca6-926e-c95221654080 req-0d8b6899-3c2f-445e-be6d-a1d053a1a507 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:12:56 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-cfdfce09-6111-4ca6-926e-c95221654080 req-0d8b6899-3c2f-445e-be6d-a1d053a1a507 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:12:56 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.compute.server_external_events [req-cfdfce09-6111-4ca6-926e-c95221654080 req-0d8b6899-3c2f-445e-be6d-a1d053a1a507 service nova] Unable to find a host for instance d41f0acf-e06f-4837-b910-021570fa41ec. Dropping event network-vif-deleted {{(pid=61209) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 19 08:12:56 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-cfdfce09-6111-4ca6-926e-c95221654080 req-0d8b6899-3c2f-445e-be6d-a1d053a1a507 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.033720 Apr 19 08:12:56 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 123/375] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:12:56 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 19 08:13:25 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-a36c75c8-ac06-43eb-8bf7-cf158c76d954 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:13:25 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-a36c75c8-ac06-43eb-8bf7-cf158c76d954 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] [instance: 60cdd0c0-d5ec-4744-932e-61cb5c48d457] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:13:25 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:13:25 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=6 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:13:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-a36c75c8-ac06-43eb-8bf7-cf158c76d954 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-a36c75c8-ac06-43eb-8bf7-cf158c76d954 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-a36c75c8-ac06-43eb-8bf7-cf158c76d954 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-a36c75c8-ac06-43eb-8bf7-cf158c76d954 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-a36c75c8-ac06-43eb-8bf7-cf158c76d954 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:25 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-a36c75c8-ac06-43eb-8bf7-cf158c76d954 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:25 user devstack@n-api.service[61208]: INFO nova.api.openstack.wsgi [None req-a36c75c8-ac06-43eb-8bf7-cf158c76d954 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] HTTP exception thrown: Instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 could not be found. Apr 19 08:13:25 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-a36c75c8-ac06-43eb-8bf7-cf158c76d954 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Request method failure captured: Apr 19 08:13:25 user devstack@n-api.service[61208]: request: DELETE /compute/v2.1/servers/60cdd0c0-d5ec-4744-932e-61cb5c48d457 HTTP/1.1 Apr 19 08:13:25 user devstack@n-api.service[61208]: Accept: application/json Apr 19 08:13:25 user devstack@n-api.service[61208]: Accept-Encoding: identity Apr 19 08:13:25 user devstack@n-api.service[61208]: Connection: close Apr 19 08:13:25 user devstack@n-api.service[61208]: Content-Length: 0 Apr 19 08:13:25 user devstack@n-api.service[61208]: Content-Type: application/json Apr 19 08:13:25 user devstack@n-api.service[61208]: Host: 10.0.0.210 Apr 19 08:13:25 user devstack@n-api.service[61208]: Openstack-System-Scope: None Apr 19 08:13:25 user devstack@n-api.service[61208]: User-Agent: python-urllib3/1.26.15 Apr 19 08:13:25 user devstack@n-api.service[61208]: X-Auth-Token: gAAAAABkP6CgJxHidkjfoI--LDc5KvPpxSL89iY0OQsgPWUWUwFCVTzN7vYbsmYbjqcr3a4kcC_FKoqqnWkAlNd7891u-NNsLCYF3a-1uzY8KvyIhFlN2QzUrMw9qIQ2ybW8b4PmlQfATGblc4It1EJEC8lsRNjxADFPe0BXOMqv3GlfwuvJ6XY Apr 19 08:13:25 user devstack@n-api.service[61208]: X-Domain-Id: None Apr 19 08:13:25 user devstack@n-api.service[61208]: X-Domain-Name: None Apr 19 08:13:25 user devstack@n-api.service[61208]: X-Identity-Status: Confirmed Apr 19 08:13:25 user devstack@n-api.service[61208]: X-Is-Admin-Project: True Apr 19 08:13:25 user devstack@n-api.service[61208]: X-Project-Domain-Id: default Apr 19 08:13:25 user devstack@n-api.service[61208]: X-Project-Domain-Name: Default Apr 19 08:13:25 user devstack@n-api.service[61208]: X-Project-Id: 789f98320d1745918cc7e2ca0ddf0ca8 Apr 19 08:13:25 user devstack@n-api.service[61208]: X-Project-Name: tempest-ServersNegativeTestJSON-1657975515 Apr 19 08:13:25 user devstack@n-api.service[61208]: X-Role: reader,member Apr 19 08:13:25 user devstack@n-api.service[61208]: X-Roles: reader,member Apr 19 08:13:26 user devstack@n-api.service[61208]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/789f98320d1745918cc7e2ca0ddf0ca8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/789f98320d1745918cc7e2ca0ddf0ca8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/789f98320d1745918cc7e2ca0ddf0ca8"}]}] Apr 19 08:13:26 user devstack@n-api.service[61208]: X-Tenant: tempest-ServersNegativeTestJSON-1657975515 Apr 19 08:13:26 user devstack@n-api.service[61208]: X-Tenant-Id: 789f98320d1745918cc7e2ca0ddf0ca8 Apr 19 08:13:26 user devstack@n-api.service[61208]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657975515 Apr 19 08:13:26 user devstack@n-api.service[61208]: X-User: tempest-ServersNegativeTestJSON-1657975515-project-member Apr 19 08:13:26 user devstack@n-api.service[61208]: X-User-Domain-Id: default Apr 19 08:13:26 user devstack@n-api.service[61208]: X-User-Domain-Name: Default Apr 19 08:13:26 user devstack@n-api.service[61208]: X-User-Id: 2027c586717a407baa7cd8f3cdc56459 Apr 19 08:13:26 user devstack@n-api.service[61208]: X-User-Name: tempest-ServersNegativeTestJSON-1657975515-project-member Apr 19 08:13:26 user devstack@n-api.service[61208]: method: > Apr 19 08:13:26 user devstack@n-api.service[61208]: exception: Instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 could not be found. Apr 19 08:13:26 user devstack@n-api.service[61208]: action_args: {'id': '60cdd0c0-d5ec-4744-932e-61cb5c48d457'} Apr 19 08:13:26 user devstack@n-api.service[61208]: {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 could not be found. Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 could not be found. Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 could not be found. Apr 19 08:13:26 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:13:26 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-a36c75c8-ac06-43eb-8bf7-cf158c76d954 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Returning 404 to user: Instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 could not be found. {{(pid=61208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:13:26 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-a36c75c8-ac06-43eb-8bf7-cf158c76d954 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/60cdd0c0-d5ec-4744-932e-61cb5c48d457" status: 404 len: 111 microversion: 2.1 time: 0.039101 Apr 19 08:13:26 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 126/376] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:13:25 2023] DELETE /compute/v2.1/servers/60cdd0c0-d5ec-4744-932e-61cb5c48d457 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:13:26 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=2 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:13:26 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=2 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:13:26 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-3f70724c-3e69-451f-9290-836e77f298dc tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:13:26 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-3f70724c-3e69-451f-9290-836e77f298dc tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] [instance: 60cdd0c0-d5ec-4744-932e-61cb5c48d457] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:13:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-3f70724c-3e69-451f-9290-836e77f298dc tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-3f70724c-3e69-451f-9290-836e77f298dc tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-3f70724c-3e69-451f-9290-836e77f298dc tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-3f70724c-3e69-451f-9290-836e77f298dc tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-3f70724c-3e69-451f-9290-836e77f298dc tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-3f70724c-3e69-451f-9290-836e77f298dc tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:26 user devstack@n-api.service[61210]: INFO nova.api.openstack.wsgi [None req-3f70724c-3e69-451f-9290-836e77f298dc tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] HTTP exception thrown: Instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 could not be found. Apr 19 08:13:26 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-3f70724c-3e69-451f-9290-836e77f298dc tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Request method failure captured: Apr 19 08:13:26 user devstack@n-api.service[61210]: request: GET /compute/v2.1/servers/60cdd0c0-d5ec-4744-932e-61cb5c48d457 HTTP/1.1 Apr 19 08:13:26 user devstack@n-api.service[61210]: Accept: application/json Apr 19 08:13:26 user devstack@n-api.service[61210]: Accept-Encoding: identity Apr 19 08:13:26 user devstack@n-api.service[61210]: Connection: close Apr 19 08:13:26 user devstack@n-api.service[61210]: Content-Length: 0 Apr 19 08:13:26 user devstack@n-api.service[61210]: Content-Type: application/json Apr 19 08:13:26 user devstack@n-api.service[61210]: Host: 10.0.0.210 Apr 19 08:13:26 user devstack@n-api.service[61210]: Openstack-System-Scope: None Apr 19 08:13:26 user devstack@n-api.service[61210]: User-Agent: python-urllib3/1.26.15 Apr 19 08:13:26 user devstack@n-api.service[61210]: X-Auth-Token: gAAAAABkP6CgJxHidkjfoI--LDc5KvPpxSL89iY0OQsgPWUWUwFCVTzN7vYbsmYbjqcr3a4kcC_FKoqqnWkAlNd7891u-NNsLCYF3a-1uzY8KvyIhFlN2QzUrMw9qIQ2ybW8b4PmlQfATGblc4It1EJEC8lsRNjxADFPe0BXOMqv3GlfwuvJ6XY Apr 19 08:13:26 user devstack@n-api.service[61210]: X-Domain-Id: None Apr 19 08:13:26 user devstack@n-api.service[61210]: X-Domain-Name: None Apr 19 08:13:26 user devstack@n-api.service[61210]: X-Identity-Status: Confirmed Apr 19 08:13:26 user devstack@n-api.service[61210]: X-Is-Admin-Project: True Apr 19 08:13:26 user devstack@n-api.service[61210]: X-Project-Domain-Id: default Apr 19 08:13:26 user devstack@n-api.service[61210]: X-Project-Domain-Name: Default Apr 19 08:13:26 user devstack@n-api.service[61210]: X-Project-Id: 789f98320d1745918cc7e2ca0ddf0ca8 Apr 19 08:13:26 user devstack@n-api.service[61210]: X-Project-Name: tempest-ServersNegativeTestJSON-1657975515 Apr 19 08:13:26 user devstack@n-api.service[61210]: X-Role: reader,member Apr 19 08:13:26 user devstack@n-api.service[61210]: X-Roles: reader,member Apr 19 08:13:26 user devstack@n-api.service[61210]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/789f98320d1745918cc7e2ca0ddf0ca8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/789f98320d1745918cc7e2ca0ddf0ca8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/789f98320d1745918cc7e2ca0ddf0ca8"}]}] Apr 19 08:13:26 user devstack@n-api.service[61210]: X-Tenant: tempest-ServersNegativeTestJSON-1657975515 Apr 19 08:13:26 user devstack@n-api.service[61210]: X-Tenant-Id: 789f98320d1745918cc7e2ca0ddf0ca8 Apr 19 08:13:26 user devstack@n-api.service[61210]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657975515 Apr 19 08:13:26 user devstack@n-api.service[61210]: X-User: tempest-ServersNegativeTestJSON-1657975515-project-member Apr 19 08:13:26 user devstack@n-api.service[61210]: X-User-Domain-Id: default Apr 19 08:13:26 user devstack@n-api.service[61210]: X-User-Domain-Name: Default Apr 19 08:13:26 user devstack@n-api.service[61210]: X-User-Id: 2027c586717a407baa7cd8f3cdc56459 Apr 19 08:13:26 user devstack@n-api.service[61210]: X-User-Name: tempest-ServersNegativeTestJSON-1657975515-project-member Apr 19 08:13:26 user devstack@n-api.service[61210]: method: > Apr 19 08:13:26 user devstack@n-api.service[61210]: exception: Instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 could not be found. Apr 19 08:13:26 user devstack@n-api.service[61210]: action_args: {'id': '60cdd0c0-d5ec-4744-932e-61cb5c48d457'} Apr 19 08:13:26 user devstack@n-api.service[61210]: {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 could not be found. Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 could not be found. Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 could not be found. Apr 19 08:13:26 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:13:26 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-3f70724c-3e69-451f-9290-836e77f298dc tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Returning 404 to user: Instance 60cdd0c0-d5ec-4744-932e-61cb5c48d457 could not be found. {{(pid=61210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:13:26 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-3f70724c-3e69-451f-9290-836e77f298dc tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/60cdd0c0-d5ec-4744-932e-61cb5c48d457" status: 404 len: 111 microversion: 2.1 time: 0.033001 Apr 19 08:13:26 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 128/377] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:13:26 2023] GET /compute/v2.1/servers/60cdd0c0-d5ec-4744-932e-61cb5c48d457 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:13:26 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-4e4814d0-4a6d-4451-a5ba-1eb72d572462 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:13:26 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-4e4814d0-4a6d-4451-a5ba-1eb72d572462 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] [instance: 266d27ff-db1d-443a-8562-b67a859afe20] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:13:26 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:13:26 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=6 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:13:26 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:13:26 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=4 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:13:26 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-4e4814d0-4a6d-4451-a5ba-1eb72d572462 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:26 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-4e4814d0-4a6d-4451-a5ba-1eb72d572462 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:26 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-4e4814d0-4a6d-4451-a5ba-1eb72d572462 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:26 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-4e4814d0-4a6d-4451-a5ba-1eb72d572462 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:26 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-4e4814d0-4a6d-4451-a5ba-1eb72d572462 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:26 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-4e4814d0-4a6d-4451-a5ba-1eb72d572462 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:26 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-4e4814d0-4a6d-4451-a5ba-1eb72d572462 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] [instance: 266d27ff-db1d-443a-8562-b67a859afe20] Going to try to terminate instance {{(pid=61209) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:13:26 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-4e4814d0-4a6d-4451-a5ba-1eb72d572462 tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/266d27ff-db1d-443a-8562-b67a859afe20" status: 204 len: 0 microversion: 2.1 time: 0.139763 Apr 19 08:13:26 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 124/378] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:13:26 2023] DELETE /compute/v2.1/servers/266d27ff-db1d-443a-8562-b67a859afe20 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 08:13:26 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-758870e7-2633-4bcd-8c50-e0ae992521ea tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:13:26 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-758870e7-2633-4bcd-8c50-e0ae992521ea tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] [instance: 266d27ff-db1d-443a-8562-b67a859afe20] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:13:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-758870e7-2633-4bcd-8c50-e0ae992521ea tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-758870e7-2633-4bcd-8c50-e0ae992521ea tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-758870e7-2633-4bcd-8c50-e0ae992521ea tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-758870e7-2633-4bcd-8c50-e0ae992521ea tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-758870e7-2633-4bcd-8c50-e0ae992521ea tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-758870e7-2633-4bcd-8c50-e0ae992521ea tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:26 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-758870e7-2633-4bcd-8c50-e0ae992521ea tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2027c586717a407baa7cd8f3cdc56459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f98320d1745918cc7e2ca0ddf0ca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:13:26 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-758870e7-2633-4bcd-8c50-e0ae992521ea tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/266d27ff-db1d-443a-8562-b67a859afe20" status: 200 len: 1499 microversion: 2.1 time: 0.313893 Apr 19 08:13:26 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 127/379] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:13:26 2023] GET /compute/v2.1/servers/266d27ff-db1d-443a-8562-b67a859afe20 => generated 1499 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:13:26 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-5fe56140-05e6-488f-b07a-53ff8fd947ea req-7d23b4fe-f3c4-472d-8b10-ee72e9604154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "266d27ff-db1d-443a-8562-b67a859afe20", "name": "network-vif-unplugged", "status": "completed", "tag": "53ae4f57-536a-4554-9f8c-1c465454184c"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:13:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-5fe56140-05e6-488f-b07a-53ff8fd947ea req-7d23b4fe-f3c4-472d-8b10-ee72e9604154 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-5fe56140-05e6-488f-b07a-53ff8fd947ea req-7d23b4fe-f3c4-472d-8b10-ee72e9604154 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-5fe56140-05e6-488f-b07a-53ff8fd947ea req-7d23b4fe-f3c4-472d-8b10-ee72e9604154 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:26 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-5fe56140-05e6-488f-b07a-53ff8fd947ea req-7d23b4fe-f3c4-472d-8b10-ee72e9604154 service nova] Creating event network-vif-unplugged:53ae4f57-536a-4554-9f8c-1c465454184c for instance 266d27ff-db1d-443a-8562-b67a859afe20 on user Apr 19 08:13:26 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-5fe56140-05e6-488f-b07a-53ff8fd947ea req-7d23b4fe-f3c4-472d-8b10-ee72e9604154 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027578 Apr 19 08:13:26 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 129/380] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:13:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:13:28 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-3a2baea8-6471-4d6c-ac9f-0eaf4d3cf068 req-776421d3-bd51-413c-a763-0037a6e56931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "266d27ff-db1d-443a-8562-b67a859afe20", "name": "network-vif-plugged", "status": "completed", "tag": "53ae4f57-536a-4554-9f8c-1c465454184c"}, {"server_uuid": "266d27ff-db1d-443a-8562-b67a859afe20", "name": "network-vif-deleted", "tag": "53ae4f57-536a-4554-9f8c-1c465454184c"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:13:28 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-3a2baea8-6471-4d6c-ac9f-0eaf4d3cf068 req-776421d3-bd51-413c-a763-0037a6e56931 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:28 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-3a2baea8-6471-4d6c-ac9f-0eaf4d3cf068 req-776421d3-bd51-413c-a763-0037a6e56931 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:28 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-3a2baea8-6471-4d6c-ac9f-0eaf4d3cf068 req-776421d3-bd51-413c-a763-0037a6e56931 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:28 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-3a2baea8-6471-4d6c-ac9f-0eaf4d3cf068 req-776421d3-bd51-413c-a763-0037a6e56931 service nova] Creating event network-vif-plugged:53ae4f57-536a-4554-9f8c-1c465454184c for instance 266d27ff-db1d-443a-8562-b67a859afe20 on user Apr 19 08:13:28 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-3a2baea8-6471-4d6c-ac9f-0eaf4d3cf068 req-776421d3-bd51-413c-a763-0037a6e56931 service nova] Creating event network-vif-deleted:53ae4f57-536a-4554-9f8c-1c465454184c for instance 266d27ff-db1d-443a-8562-b67a859afe20 on user Apr 19 08:13:28 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-3a2baea8-6471-4d6c-ac9f-0eaf4d3cf068 req-776421d3-bd51-413c-a763-0037a6e56931 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028856 Apr 19 08:13:28 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 125/381] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:13:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:13:39 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-afe09e48-af77-4055-8348-428bdbae0c0f tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:13:39 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-afe09e48-af77-4055-8348-428bdbae0c0f tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: d41f0acf-e06f-4837-b910-021570fa41ec] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:13:39 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=4 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:13:39 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=8 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:13:39 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-afe09e48-af77-4055-8348-428bdbae0c0f tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:39 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-afe09e48-af77-4055-8348-428bdbae0c0f tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:39 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-afe09e48-af77-4055-8348-428bdbae0c0f tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:39 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-afe09e48-af77-4055-8348-428bdbae0c0f tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:39 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-afe09e48-af77-4055-8348-428bdbae0c0f tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:39 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-afe09e48-af77-4055-8348-428bdbae0c0f tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:39 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-afe09e48-af77-4055-8348-428bdbae0c0f tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:39 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-afe09e48-af77-4055-8348-428bdbae0c0f tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:39 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-afe09e48-af77-4055-8348-428bdbae0c0f tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:39 user devstack@n-api.service[61208]: DEBUG nova.objects.instance [None req-afe09e48-af77-4055-8348-428bdbae0c0f tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lazy-loading 'fault' on Instance uuid d41f0acf-e06f-4837-b910-021570fa41ec {{(pid=61208) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 19 08:13:39 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-afe09e48-af77-4055-8348-428bdbae0c0f tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:13:39 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-afe09e48-af77-4055-8348-428bdbae0c0f tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:13:39 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-afe09e48-af77-4055-8348-428bdbae0c0f tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:13:39 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-afe09e48-af77-4055-8348-428bdbae0c0f tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d41f0acf-e06f-4837-b910-021570fa41ec" status: 200 len: 1650 microversion: 2.87 time: 0.106689 Apr 19 08:13:39 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 128/382] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:13:39 2023] GET /compute/v2.1/servers/d41f0acf-e06f-4837-b910-021570fa41ec => generated 1650 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 08:13:39 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=4 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:13:39 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=4 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:13:39 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-f6b2a4eb-da64-4b53-aa7e-03dcdbaa308c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:13:39 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-f6b2a4eb-da64-4b53-aa7e-03dcdbaa308c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: d41f0acf-e06f-4837-b910-021570fa41ec] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:13:39 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f6b2a4eb-da64-4b53-aa7e-03dcdbaa308c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:39 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f6b2a4eb-da64-4b53-aa7e-03dcdbaa308c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:39 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f6b2a4eb-da64-4b53-aa7e-03dcdbaa308c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:39 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f6b2a4eb-da64-4b53-aa7e-03dcdbaa308c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:39 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f6b2a4eb-da64-4b53-aa7e-03dcdbaa308c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:39 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f6b2a4eb-da64-4b53-aa7e-03dcdbaa308c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:39 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-f6b2a4eb-da64-4b53-aa7e-03dcdbaa308c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: d41f0acf-e06f-4837-b910-021570fa41ec] Going to try to terminate instance {{(pid=61210) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:13:39 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-f6b2a4eb-da64-4b53-aa7e-03dcdbaa308c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: d41f0acf-e06f-4837-b910-021570fa41ec] Doing local delete in cell bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10(cell1) {{(pid=61210) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 19 08:13:39 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f6b2a4eb-da64-4b53-aa7e-03dcdbaa308c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:39 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f6b2a4eb-da64-4b53-aa7e-03dcdbaa308c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:39 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-f6b2a4eb-da64-4b53-aa7e-03dcdbaa308c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:39 user devstack@n-api.service[61210]: WARNING nova.compute.api [None req-f6b2a4eb-da64-4b53-aa7e-03dcdbaa308c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: d41f0acf-e06f-4837-b910-021570fa41ec] instance's host None is down, deleting from database Apr 19 08:13:39 user devstack@n-api.service[61210]: DEBUG nova.network.neutron [None req-f6b2a4eb-da64-4b53-aa7e-03dcdbaa308c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: d41f0acf-e06f-4837-b910-021570fa41ec] deallocate_for_instance() {{(pid=61210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 19 08:13:39 user devstack@n-api.service[61210]: DEBUG nova.network.neutron [None req-f6b2a4eb-da64-4b53-aa7e-03dcdbaa308c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: d41f0acf-e06f-4837-b910-021570fa41ec] Instance cache missing network info. {{(pid=61210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 19 08:13:39 user devstack@n-api.service[61210]: DEBUG nova.network.neutron [None req-f6b2a4eb-da64-4b53-aa7e-03dcdbaa308c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: d41f0acf-e06f-4837-b910-021570fa41ec] Updating instance_info_cache with network_info: [] {{(pid=61210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 19 08:13:39 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-f6b2a4eb-da64-4b53-aa7e-03dcdbaa308c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: d41f0acf-e06f-4837-b910-021570fa41ec] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61210) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 19 08:13:39 user devstack@n-api.service[61210]: WARNING nova.compute.api [None req-f6b2a4eb-da64-4b53-aa7e-03dcdbaa308c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: d41f0acf-e06f-4837-b910-021570fa41ec] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 19 08:13:40 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-f6b2a4eb-da64-4b53-aa7e-03dcdbaa308c tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d41f0acf-e06f-4837-b910-021570fa41ec" status: 204 len: 0 microversion: 2.87 time: 0.569555 Apr 19 08:13:40 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 130/383] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 08:13:39 2023] DELETE /compute/v2.1/servers/d41f0acf-e06f-4837-b910-021570fa41ec => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 08:13:40 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:13:40 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:13:40 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-535423b4-a8c9-402b-8644-6099c1d51b91 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:13:40 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-535423b4-a8c9-402b-8644-6099c1d51b91 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: d41f0acf-e06f-4837-b910-021570fa41ec] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:13:40 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-535423b4-a8c9-402b-8644-6099c1d51b91 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:40 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-535423b4-a8c9-402b-8644-6099c1d51b91 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:40 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-535423b4-a8c9-402b-8644-6099c1d51b91 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:40 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-535423b4-a8c9-402b-8644-6099c1d51b91 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:40 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-535423b4-a8c9-402b-8644-6099c1d51b91 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:40 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-535423b4-a8c9-402b-8644-6099c1d51b91 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:40 user devstack@n-api.service[61209]: INFO nova.api.openstack.wsgi [None req-535423b4-a8c9-402b-8644-6099c1d51b91 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] HTTP exception thrown: Instance d41f0acf-e06f-4837-b910-021570fa41ec could not be found. Apr 19 08:13:40 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-535423b4-a8c9-402b-8644-6099c1d51b91 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Request method failure captured: Apr 19 08:13:40 user devstack@n-api.service[61209]: request: GET /compute/v2.1/servers/d41f0acf-e06f-4837-b910-021570fa41ec HTTP/1.1 Apr 19 08:13:40 user devstack@n-api.service[61209]: Accept: application/json Apr 19 08:13:40 user devstack@n-api.service[61209]: Accept-Encoding: identity Apr 19 08:13:40 user devstack@n-api.service[61209]: Connection: close Apr 19 08:13:40 user devstack@n-api.service[61209]: Content-Length: 0 Apr 19 08:13:40 user devstack@n-api.service[61209]: Content-Type: application/json Apr 19 08:13:40 user devstack@n-api.service[61209]: Host: 10.0.0.210 Apr 19 08:13:40 user devstack@n-api.service[61209]: Openstack-System-Scope: None Apr 19 08:13:40 user devstack@n-api.service[61209]: User-Agent: python-urllib3/1.26.15 Apr 19 08:13:40 user devstack@n-api.service[61209]: X-Auth-Token: gAAAAABkP6Dp-ckklASsHR16Ty1V7tF5AaUkLgi1XHB_iUkWABV1TkB4TpQkzf2iSTsseQeGeK2gtuAPoCcF1Ie_2B9XFXfoQNGiZe9mud6O87gqX4drt8Tr5iI4jC18u0EZt5ZKgabAj35kP5xKdQjnBhFPWeyepSIbrWYy3pDb-H_U9YiRHV8 Apr 19 08:13:40 user devstack@n-api.service[61209]: X-Domain-Id: None Apr 19 08:13:40 user devstack@n-api.service[61209]: X-Domain-Name: None Apr 19 08:13:40 user devstack@n-api.service[61209]: X-Identity-Status: Confirmed Apr 19 08:13:40 user devstack@n-api.service[61209]: X-Is-Admin-Project: True Apr 19 08:13:40 user devstack@n-api.service[61209]: X-Openstack-Nova-Api-Version: 2.87 Apr 19 08:13:40 user devstack@n-api.service[61209]: X-Project-Domain-Id: default Apr 19 08:13:40 user devstack@n-api.service[61209]: X-Project-Domain-Name: Default Apr 19 08:13:40 user devstack@n-api.service[61209]: X-Project-Id: 7973fa0075de42e9a74627ae9cd98d9f Apr 19 08:13:40 user devstack@n-api.service[61209]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2017668221 Apr 19 08:13:40 user devstack@n-api.service[61209]: X-Role: reader,member Apr 19 08:13:40 user devstack@n-api.service[61209]: X-Roles: reader,member Apr 19 08:13:40 user devstack@n-api.service[61209]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7973fa0075de42e9a74627ae9cd98d9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7973fa0075de42e9a74627ae9cd98d9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7973fa0075de42e9a74627ae9cd98d9f"}]}] Apr 19 08:13:40 user devstack@n-api.service[61209]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2017668221 Apr 19 08:13:40 user devstack@n-api.service[61209]: X-Tenant-Id: 7973fa0075de42e9a74627ae9cd98d9f Apr 19 08:13:40 user devstack@n-api.service[61209]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2017668221 Apr 19 08:13:40 user devstack@n-api.service[61209]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member Apr 19 08:13:40 user devstack@n-api.service[61209]: X-User-Domain-Id: default Apr 19 08:13:40 user devstack@n-api.service[61209]: X-User-Domain-Name: Default Apr 19 08:13:40 user devstack@n-api.service[61209]: X-User-Id: 5530f99504de4426ba41cfa691c430c0 Apr 19 08:13:40 user devstack@n-api.service[61209]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member Apr 19 08:13:40 user devstack@n-api.service[61209]: method: > Apr 19 08:13:40 user devstack@n-api.service[61209]: exception: Instance d41f0acf-e06f-4837-b910-021570fa41ec could not be found. Apr 19 08:13:40 user devstack@n-api.service[61209]: action_args: {'id': 'd41f0acf-e06f-4837-b910-021570fa41ec'} Apr 19 08:13:40 user devstack@n-api.service[61209]: {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d41f0acf-e06f-4837-b910-021570fa41ec could not be found. Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d41f0acf-e06f-4837-b910-021570fa41ec could not be found. Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d41f0acf-e06f-4837-b910-021570fa41ec could not be found. Apr 19 08:13:40 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:13:40 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-535423b4-a8c9-402b-8644-6099c1d51b91 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Returning 404 to user: Instance d41f0acf-e06f-4837-b910-021570fa41ec could not be found. {{(pid=61209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:13:40 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-535423b4-a8c9-402b-8644-6099c1d51b91 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d41f0acf-e06f-4837-b910-021570fa41ec" status: 404 len: 111 microversion: 2.87 time: 0.040702 Apr 19 08:13:40 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 126/384] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:13:40 2023] GET /compute/v2.1/servers/d41f0acf-e06f-4837-b910-021570fa41ec => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 08:13:40 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-363bbda0-9a6b-4403-8b77-247f0039aabf tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:13:40 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-363bbda0-9a6b-4403-8b77-247f0039aabf tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 092ebf79-b95c-460d-8f90-28d4e4a7ce7e] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:13:40 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-363bbda0-9a6b-4403-8b77-247f0039aabf tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:40 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-363bbda0-9a6b-4403-8b77-247f0039aabf tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:40 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-363bbda0-9a6b-4403-8b77-247f0039aabf tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:40 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-363bbda0-9a6b-4403-8b77-247f0039aabf tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:40 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-363bbda0-9a6b-4403-8b77-247f0039aabf tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:40 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-363bbda0-9a6b-4403-8b77-247f0039aabf tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:40 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-363bbda0-9a6b-4403-8b77-247f0039aabf tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 092ebf79-b95c-460d-8f90-28d4e4a7ce7e] Going to try to terminate instance {{(pid=61208) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:13:40 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-363bbda0-9a6b-4403-8b77-247f0039aabf tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/092ebf79-b95c-460d-8f90-28d4e4a7ce7e" status: 204 len: 0 microversion: 2.87 time: 0.112675 Apr 19 08:13:40 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 129/385] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 08:13:40 2023] DELETE /compute/v2.1/servers/092ebf79-b95c-460d-8f90-28d4e4a7ce7e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 08:13:40 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-af9bc4aa-8c28-4378-82a7-2a9c979524bb tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:13:40 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-af9bc4aa-8c28-4378-82a7-2a9c979524bb tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 092ebf79-b95c-460d-8f90-28d4e4a7ce7e] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:13:40 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-af9bc4aa-8c28-4378-82a7-2a9c979524bb tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:40 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-af9bc4aa-8c28-4378-82a7-2a9c979524bb tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:40 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-af9bc4aa-8c28-4378-82a7-2a9c979524bb tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:40 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-af9bc4aa-8c28-4378-82a7-2a9c979524bb tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:40 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-af9bc4aa-8c28-4378-82a7-2a9c979524bb tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:40 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-af9bc4aa-8c28-4378-82a7-2a9c979524bb tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:41 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-af9bc4aa-8c28-4378-82a7-2a9c979524bb tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:13:41 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-af9bc4aa-8c28-4378-82a7-2a9c979524bb tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:13:41 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-af9bc4aa-8c28-4378-82a7-2a9c979524bb tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:13:41 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-af9bc4aa-8c28-4378-82a7-2a9c979524bb tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/092ebf79-b95c-460d-8f90-28d4e4a7ce7e" status: 200 len: 1697 microversion: 2.87 time: 0.398532 Apr 19 08:13:41 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 131/386] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:13:40 2023] GET /compute/v2.1/servers/092ebf79-b95c-460d-8f90-28d4e4a7ce7e => generated 1697 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 08:13:41 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-4810cdc1-b2c7-437f-8d60-1a063b838c05 req-bec6472f-f961-47db-8187-35d2e54620cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092ebf79-b95c-460d-8f90-28d4e4a7ce7e", "name": "network-vif-unplugged", "status": "completed", "tag": "49511f6f-4e05-454b-afda-974e537666cb"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:13:41 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-4810cdc1-b2c7-437f-8d60-1a063b838c05 req-bec6472f-f961-47db-8187-35d2e54620cd service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:41 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-4810cdc1-b2c7-437f-8d60-1a063b838c05 req-bec6472f-f961-47db-8187-35d2e54620cd service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:41 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-4810cdc1-b2c7-437f-8d60-1a063b838c05 req-bec6472f-f961-47db-8187-35d2e54620cd service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:41 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-4810cdc1-b2c7-437f-8d60-1a063b838c05 req-bec6472f-f961-47db-8187-35d2e54620cd service nova] Creating event network-vif-unplugged:49511f6f-4e05-454b-afda-974e537666cb for instance 092ebf79-b95c-460d-8f90-28d4e4a7ce7e on user Apr 19 08:13:41 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-4810cdc1-b2c7-437f-8d60-1a063b838c05 req-bec6472f-f961-47db-8187-35d2e54620cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145095 Apr 19 08:13:41 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 127/387] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:13:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:13:41 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-96d1015a-9167-418c-bff8-b8b1c1d7cab0 req-29c18b17-0505-4aa6-98e4-a7ddb4a6bb84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092ebf79-b95c-460d-8f90-28d4e4a7ce7e", "name": "network-vif-deleted", "tag": "49511f6f-4e05-454b-afda-974e537666cb"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:13:41 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-96d1015a-9167-418c-bff8-b8b1c1d7cab0 req-29c18b17-0505-4aa6-98e4-a7ddb4a6bb84 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:41 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-96d1015a-9167-418c-bff8-b8b1c1d7cab0 req-29c18b17-0505-4aa6-98e4-a7ddb4a6bb84 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:41 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-96d1015a-9167-418c-bff8-b8b1c1d7cab0 req-29c18b17-0505-4aa6-98e4-a7ddb4a6bb84 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:41 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-96d1015a-9167-418c-bff8-b8b1c1d7cab0 req-29c18b17-0505-4aa6-98e4-a7ddb4a6bb84 service nova] Creating event network-vif-deleted:49511f6f-4e05-454b-afda-974e537666cb for instance 092ebf79-b95c-460d-8f90-28d4e4a7ce7e on user Apr 19 08:13:41 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-96d1015a-9167-418c-bff8-b8b1c1d7cab0 req-29c18b17-0505-4aa6-98e4-a7ddb4a6bb84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036293 Apr 19 08:13:41 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 130/388] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:13:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:13:43 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-be9b0089-26e3-4f15-9b42-86ebffb93b79 req-586542b5-7d9f-437d-bbb3-52faf436eb5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092ebf79-b95c-460d-8f90-28d4e4a7ce7e", "name": "network-vif-plugged", "status": "completed", "tag": "49511f6f-4e05-454b-afda-974e537666cb"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:13:43 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-be9b0089-26e3-4f15-9b42-86ebffb93b79 req-586542b5-7d9f-437d-bbb3-52faf436eb5a service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:13:43 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-be9b0089-26e3-4f15-9b42-86ebffb93b79 req-586542b5-7d9f-437d-bbb3-52faf436eb5a service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:13:43 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-be9b0089-26e3-4f15-9b42-86ebffb93b79 req-586542b5-7d9f-437d-bbb3-52faf436eb5a service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:13:43 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-be9b0089-26e3-4f15-9b42-86ebffb93b79 req-586542b5-7d9f-437d-bbb3-52faf436eb5a service nova] Creating event network-vif-plugged:49511f6f-4e05-454b-afda-974e537666cb for instance 092ebf79-b95c-460d-8f90-28d4e4a7ce7e on user Apr 19 08:13:43 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-be9b0089-26e3-4f15-9b42-86ebffb93b79 req-586542b5-7d9f-437d-bbb3-52faf436eb5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029894 Apr 19 08:13:43 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 132/389] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:13:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:14:16 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=4 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:14:16 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=4 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:14:16 user devstack@n-api.service[61209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 08:14:16 user devstack@n-api.service[61209]: Wed Apr 19 08:14:16 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/266d27ff-db1d-443a-8562-b67a859afe20 (ip 10.0.0.210) !!! Apr 19 08:14:16 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-e6f85f62-9661-4cad-850a-351266a523ce tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:14:16 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-e6f85f62-9661-4cad-850a-351266a523ce tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] [instance: 266d27ff-db1d-443a-8562-b67a859afe20] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:14:16 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e6f85f62-9661-4cad-850a-351266a523ce tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:14:16 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e6f85f62-9661-4cad-850a-351266a523ce tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:14:16 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e6f85f62-9661-4cad-850a-351266a523ce tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:14:16 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e6f85f62-9661-4cad-850a-351266a523ce tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:14:16 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e6f85f62-9661-4cad-850a-351266a523ce tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:14:16 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-e6f85f62-9661-4cad-850a-351266a523ce tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:14:16 user devstack@n-api.service[61209]: INFO nova.api.openstack.wsgi [None req-e6f85f62-9661-4cad-850a-351266a523ce tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] HTTP exception thrown: Instance 266d27ff-db1d-443a-8562-b67a859afe20 could not be found. Apr 19 08:14:16 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-e6f85f62-9661-4cad-850a-351266a523ce tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Request method failure captured: Apr 19 08:14:16 user devstack@n-api.service[61209]: request: GET /compute/v2.1/servers/266d27ff-db1d-443a-8562-b67a859afe20 HTTP/1.1 Apr 19 08:14:16 user devstack@n-api.service[61209]: Accept: application/json Apr 19 08:14:16 user devstack@n-api.service[61209]: Accept-Encoding: identity Apr 19 08:14:16 user devstack@n-api.service[61209]: Connection: close Apr 19 08:14:16 user devstack@n-api.service[61209]: Content-Length: 0 Apr 19 08:14:16 user devstack@n-api.service[61209]: Content-Type: application/json Apr 19 08:14:16 user devstack@n-api.service[61209]: Host: 10.0.0.210 Apr 19 08:14:16 user devstack@n-api.service[61209]: Openstack-System-Scope: None Apr 19 08:14:16 user devstack@n-api.service[61209]: User-Agent: python-urllib3/1.26.15 Apr 19 08:14:16 user devstack@n-api.service[61209]: X-Auth-Token: gAAAAABkP6CgJxHidkjfoI--LDc5KvPpxSL89iY0OQsgPWUWUwFCVTzN7vYbsmYbjqcr3a4kcC_FKoqqnWkAlNd7891u-NNsLCYF3a-1uzY8KvyIhFlN2QzUrMw9qIQ2ybW8b4PmlQfATGblc4It1EJEC8lsRNjxADFPe0BXOMqv3GlfwuvJ6XY Apr 19 08:14:16 user devstack@n-api.service[61209]: X-Domain-Id: None Apr 19 08:14:16 user devstack@n-api.service[61209]: X-Domain-Name: None Apr 19 08:14:16 user devstack@n-api.service[61209]: X-Identity-Status: Confirmed Apr 19 08:14:16 user devstack@n-api.service[61209]: X-Is-Admin-Project: True Apr 19 08:14:16 user devstack@n-api.service[61209]: X-Project-Domain-Id: default Apr 19 08:14:16 user devstack@n-api.service[61209]: X-Project-Domain-Name: Default Apr 19 08:14:16 user devstack@n-api.service[61209]: X-Project-Id: 789f98320d1745918cc7e2ca0ddf0ca8 Apr 19 08:14:16 user devstack@n-api.service[61209]: X-Project-Name: tempest-ServersNegativeTestJSON-1657975515 Apr 19 08:14:16 user devstack@n-api.service[61209]: X-Role: reader,member Apr 19 08:14:16 user devstack@n-api.service[61209]: X-Roles: reader,member Apr 19 08:14:16 user devstack@n-api.service[61209]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/789f98320d1745918cc7e2ca0ddf0ca8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/789f98320d1745918cc7e2ca0ddf0ca8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/789f98320d1745918cc7e2ca0ddf0ca8"}]}] Apr 19 08:14:16 user devstack@n-api.service[61209]: X-Tenant: tempest-ServersNegativeTestJSON-1657975515 Apr 19 08:14:16 user devstack@n-api.service[61209]: X-Tenant-Id: 789f98320d1745918cc7e2ca0ddf0ca8 Apr 19 08:14:16 user devstack@n-api.service[61209]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657975515 Apr 19 08:14:16 user devstack@n-api.service[61209]: X-User: tempest-ServersNegativeTestJSON-1657975515-project-member Apr 19 08:14:16 user devstack@n-api.service[61209]: X-User-Domain-Id: default Apr 19 08:14:16 user devstack@n-api.service[61209]: X-User-Domain-Name: Default Apr 19 08:14:16 user devstack@n-api.service[61209]: X-User-Id: 2027c586717a407baa7cd8f3cdc56459 Apr 19 08:14:16 user devstack@n-api.service[61209]: X-User-Name: tempest-ServersNegativeTestJSON-1657975515-project-member Apr 19 08:14:16 user devstack@n-api.service[61209]: method: > Apr 19 08:14:16 user devstack@n-api.service[61209]: exception: Instance 266d27ff-db1d-443a-8562-b67a859afe20 could not be found. Apr 19 08:14:16 user devstack@n-api.service[61209]: action_args: {'id': '266d27ff-db1d-443a-8562-b67a859afe20'} Apr 19 08:14:16 user devstack@n-api.service[61209]: {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 266d27ff-db1d-443a-8562-b67a859afe20 could not be found. Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 266d27ff-db1d-443a-8562-b67a859afe20 could not be found. Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 266d27ff-db1d-443a-8562-b67a859afe20 could not be found. Apr 19 08:14:16 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:14:16 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-e6f85f62-9661-4cad-850a-351266a523ce tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] Returning 404 to user: Instance 266d27ff-db1d-443a-8562-b67a859afe20 could not be found. {{(pid=61209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:14:16 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-e6f85f62-9661-4cad-850a-351266a523ce tempest-ServersNegativeTestJSON-1657975515 tempest-ServersNegativeTestJSON-1657975515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/266d27ff-db1d-443a-8562-b67a859afe20" status: 404 len: 111 microversion: 2.1 time: 0.040073 Apr 19 08:14:16 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 128/390] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:14:16 2023] GET /compute/v2.1/servers/266d27ff-db1d-443a-8562-b67a859afe20 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:14:31 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:14:31 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:14:31 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-820ede96-04a9-4f8c-8b24-679017c0bb6a tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:14:31 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-820ede96-04a9-4f8c-8b24-679017c0bb6a tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 092ebf79-b95c-460d-8f90-28d4e4a7ce7e] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:14:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-820ede96-04a9-4f8c-8b24-679017c0bb6a tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:14:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-820ede96-04a9-4f8c-8b24-679017c0bb6a tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:14:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-820ede96-04a9-4f8c-8b24-679017c0bb6a tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:14:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-820ede96-04a9-4f8c-8b24-679017c0bb6a tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:14:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-820ede96-04a9-4f8c-8b24-679017c0bb6a tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:14:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-820ede96-04a9-4f8c-8b24-679017c0bb6a tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:14:31 user devstack@n-api.service[61208]: INFO nova.api.openstack.wsgi [None req-820ede96-04a9-4f8c-8b24-679017c0bb6a tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] HTTP exception thrown: Instance 092ebf79-b95c-460d-8f90-28d4e4a7ce7e could not be found. Apr 19 08:14:31 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-820ede96-04a9-4f8c-8b24-679017c0bb6a tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Request method failure captured: Apr 19 08:14:31 user devstack@n-api.service[61208]: request: GET /compute/v2.1/servers/092ebf79-b95c-460d-8f90-28d4e4a7ce7e HTTP/1.1 Apr 19 08:14:31 user devstack@n-api.service[61208]: Accept: application/json Apr 19 08:14:31 user devstack@n-api.service[61208]: Accept-Encoding: identity Apr 19 08:14:31 user devstack@n-api.service[61208]: Connection: close Apr 19 08:14:31 user devstack@n-api.service[61208]: Content-Length: 0 Apr 19 08:14:31 user devstack@n-api.service[61208]: Content-Type: application/json Apr 19 08:14:31 user devstack@n-api.service[61208]: Host: 10.0.0.210 Apr 19 08:14:31 user devstack@n-api.service[61208]: Openstack-System-Scope: None Apr 19 08:14:31 user devstack@n-api.service[61208]: User-Agent: python-urllib3/1.26.15 Apr 19 08:14:31 user devstack@n-api.service[61208]: X-Auth-Token: gAAAAABkP6Dp-ckklASsHR16Ty1V7tF5AaUkLgi1XHB_iUkWABV1TkB4TpQkzf2iSTsseQeGeK2gtuAPoCcF1Ie_2B9XFXfoQNGiZe9mud6O87gqX4drt8Tr5iI4jC18u0EZt5ZKgabAj35kP5xKdQjnBhFPWeyepSIbrWYy3pDb-H_U9YiRHV8 Apr 19 08:14:31 user devstack@n-api.service[61208]: X-Domain-Id: None Apr 19 08:14:31 user devstack@n-api.service[61208]: X-Domain-Name: None Apr 19 08:14:31 user devstack@n-api.service[61208]: X-Identity-Status: Confirmed Apr 19 08:14:31 user devstack@n-api.service[61208]: X-Is-Admin-Project: True Apr 19 08:14:31 user devstack@n-api.service[61208]: X-Openstack-Nova-Api-Version: 2.87 Apr 19 08:14:31 user devstack@n-api.service[61208]: X-Project-Domain-Id: default Apr 19 08:14:31 user devstack@n-api.service[61208]: X-Project-Domain-Name: Default Apr 19 08:14:31 user devstack@n-api.service[61208]: X-Project-Id: 7973fa0075de42e9a74627ae9cd98d9f Apr 19 08:14:31 user devstack@n-api.service[61208]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2017668221 Apr 19 08:14:31 user devstack@n-api.service[61208]: X-Role: reader,member Apr 19 08:14:31 user devstack@n-api.service[61208]: X-Roles: reader,member Apr 19 08:14:31 user devstack@n-api.service[61208]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7973fa0075de42e9a74627ae9cd98d9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7973fa0075de42e9a74627ae9cd98d9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7973fa0075de42e9a74627ae9cd98d9f"}]}] Apr 19 08:14:31 user devstack@n-api.service[61208]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2017668221 Apr 19 08:14:31 user devstack@n-api.service[61208]: X-Tenant-Id: 7973fa0075de42e9a74627ae9cd98d9f Apr 19 08:14:31 user devstack@n-api.service[61208]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2017668221 Apr 19 08:14:31 user devstack@n-api.service[61208]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member Apr 19 08:14:31 user devstack@n-api.service[61208]: X-User-Domain-Id: default Apr 19 08:14:31 user devstack@n-api.service[61208]: X-User-Domain-Name: Default Apr 19 08:14:31 user devstack@n-api.service[61208]: X-User-Id: 5530f99504de4426ba41cfa691c430c0 Apr 19 08:14:31 user devstack@n-api.service[61208]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member Apr 19 08:14:31 user devstack@n-api.service[61208]: method: > Apr 19 08:14:31 user devstack@n-api.service[61208]: exception: Instance 092ebf79-b95c-460d-8f90-28d4e4a7ce7e could not be found. Apr 19 08:14:31 user devstack@n-api.service[61208]: action_args: {'id': '092ebf79-b95c-460d-8f90-28d4e4a7ce7e'} Apr 19 08:14:31 user devstack@n-api.service[61208]: {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 092ebf79-b95c-460d-8f90-28d4e4a7ce7e could not be found. Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 092ebf79-b95c-460d-8f90-28d4e4a7ce7e could not be found. Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 092ebf79-b95c-460d-8f90-28d4e4a7ce7e could not be found. Apr 19 08:14:31 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:14:31 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-820ede96-04a9-4f8c-8b24-679017c0bb6a tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Returning 404 to user: Instance 092ebf79-b95c-460d-8f90-28d4e4a7ce7e could not be found. {{(pid=61208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:14:31 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-820ede96-04a9-4f8c-8b24-679017c0bb6a tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/092ebf79-b95c-460d-8f90-28d4e4a7ce7e" status: 404 len: 111 microversion: 2.87 time: 0.054988 Apr 19 08:14:31 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 131/391] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:14:31 2023] GET /compute/v2.1/servers/092ebf79-b95c-460d-8f90-28d4e4a7ce7e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 08:14:31 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-2a05d649-8bc0-4052-ab96-48ed93c6c449 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:14:31 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-2a05d649-8bc0-4052-ab96-48ed93c6c449 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 3f04177b-d122-459b-871c-15c0964d793a] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:14:31 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:14:31 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:14:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-2a05d649-8bc0-4052-ab96-48ed93c6c449 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:14:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-2a05d649-8bc0-4052-ab96-48ed93c6c449 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:14:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-2a05d649-8bc0-4052-ab96-48ed93c6c449 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:14:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-2a05d649-8bc0-4052-ab96-48ed93c6c449 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:14:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-2a05d649-8bc0-4052-ab96-48ed93c6c449 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:14:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-2a05d649-8bc0-4052-ab96-48ed93c6c449 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:14:31 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-2a05d649-8bc0-4052-ab96-48ed93c6c449 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 3f04177b-d122-459b-871c-15c0964d793a] Going to try to terminate instance {{(pid=61210) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:14:31 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-2a05d649-8bc0-4052-ab96-48ed93c6c449 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3f04177b-d122-459b-871c-15c0964d793a" status: 204 len: 0 microversion: 2.87 time: 0.126361 Apr 19 08:14:31 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 133/392] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 19 08:14:31 2023] DELETE /compute/v2.1/servers/3f04177b-d122-459b-871c-15c0964d793a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 19 08:14:31 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:14:31 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:14:31 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-aea930cf-de28-41d0-91fe-9f43e7b56d13 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:14:31 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-aea930cf-de28-41d0-91fe-9f43e7b56d13 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 3f04177b-d122-459b-871c-15c0964d793a] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:14:31 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-aea930cf-de28-41d0-91fe-9f43e7b56d13 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:14:31 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-aea930cf-de28-41d0-91fe-9f43e7b56d13 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:14:31 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-aea930cf-de28-41d0-91fe-9f43e7b56d13 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:14:31 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-aea930cf-de28-41d0-91fe-9f43e7b56d13 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:14:31 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-aea930cf-de28-41d0-91fe-9f43e7b56d13 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:14:31 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-aea930cf-de28-41d0-91fe-9f43e7b56d13 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:14:31 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-aea930cf-de28-41d0-91fe-9f43e7b56d13 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:14:31 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-aea930cf-de28-41d0-91fe-9f43e7b56d13 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:14:31 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-aea930cf-de28-41d0-91fe-9f43e7b56d13 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5530f99504de4426ba41cfa691c430c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7973fa0075de42e9a74627ae9cd98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:14:31 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-aea930cf-de28-41d0-91fe-9f43e7b56d13 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f04177b-d122-459b-871c-15c0964d793a" status: 200 len: 1697 microversion: 2.87 time: 0.270188 Apr 19 08:14:31 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 129/393] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:14:31 2023] GET /compute/v2.1/servers/3f04177b-d122-459b-871c-15c0964d793a => generated 1697 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 19 08:14:32 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-9db32e3d-932a-4b28-a4ea-a66aa2e33719 req-44276172-720e-4739-891d-22b7397cbf02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f04177b-d122-459b-871c-15c0964d793a", "name": "network-vif-unplugged", "status": "completed", "tag": "eb1031c5-e333-4906-bb09-59f1a2ccf5a7"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:14:32 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-9db32e3d-932a-4b28-a4ea-a66aa2e33719 req-44276172-720e-4739-891d-22b7397cbf02 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:14:32 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-9db32e3d-932a-4b28-a4ea-a66aa2e33719 req-44276172-720e-4739-891d-22b7397cbf02 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:14:32 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-9db32e3d-932a-4b28-a4ea-a66aa2e33719 req-44276172-720e-4739-891d-22b7397cbf02 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:14:32 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-9db32e3d-932a-4b28-a4ea-a66aa2e33719 req-44276172-720e-4739-891d-22b7397cbf02 service nova] Creating event network-vif-unplugged:eb1031c5-e333-4906-bb09-59f1a2ccf5a7 for instance 3f04177b-d122-459b-871c-15c0964d793a on user Apr 19 08:14:32 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-9db32e3d-932a-4b28-a4ea-a66aa2e33719 req-44276172-720e-4739-891d-22b7397cbf02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029545 Apr 19 08:14:32 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 132/394] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:14:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:14:33 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-0f7ab303-aae5-48ad-aa8d-14a8989dcd57 req-c4ab1878-6af0-4f21-86d6-1ed6ba2333bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f04177b-d122-459b-871c-15c0964d793a", "name": "network-vif-deleted", "tag": "eb1031c5-e333-4906-bb09-59f1a2ccf5a7"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:14:33 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-0f7ab303-aae5-48ad-aa8d-14a8989dcd57 req-c4ab1878-6af0-4f21-86d6-1ed6ba2333bc service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:14:33 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-0f7ab303-aae5-48ad-aa8d-14a8989dcd57 req-c4ab1878-6af0-4f21-86d6-1ed6ba2333bc service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:14:33 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-0f7ab303-aae5-48ad-aa8d-14a8989dcd57 req-c4ab1878-6af0-4f21-86d6-1ed6ba2333bc service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:14:33 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-0f7ab303-aae5-48ad-aa8d-14a8989dcd57 req-c4ab1878-6af0-4f21-86d6-1ed6ba2333bc service nova] Creating event network-vif-deleted:eb1031c5-e333-4906-bb09-59f1a2ccf5a7 for instance 3f04177b-d122-459b-871c-15c0964d793a on user Apr 19 08:14:33 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-0f7ab303-aae5-48ad-aa8d-14a8989dcd57 req-c4ab1878-6af0-4f21-86d6-1ed6ba2333bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031041 Apr 19 08:14:33 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 134/395] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:14:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:14:33 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-b240d835-8186-4928-8414-ba4137d47226 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-153373410", "imageRef": "b515545f-3b22-4d80-a102-6a318ab9717a", "flavorRef": "42", "networks": [{"uuid": "d458c38a-b80a-4856-abc7-ccd346761997"}]}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:14:33 user devstack@n-api.service[61209]: DEBUG nova.network.neutron [None req-b240d835-8186-4928-8414-ba4137d47226 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] validate_networks() for [('d458c38a-b80a-4856-abc7-ccd346761997', None, None, None, None, None)] {{(pid=61209) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 08:14:33 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-b240d835-8186-4928-8414-ba4137d47226 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Flavor limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 08:14:33 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-b240d835-8186-4928-8414-ba4137d47226 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Image limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 08:14:33 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-b240d835-8186-4928-8414-ba4137d47226 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Flavor pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 08:14:33 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-b240d835-8186-4928-8414-ba4137d47226 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Image pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 08:14:33 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-b240d835-8186-4928-8414-ba4137d47226 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 08:14:33 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b240d835-8186-4928-8414-ba4137d47226 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:14:33 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b240d835-8186-4928-8414-ba4137d47226 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:14:33 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b240d835-8186-4928-8414-ba4137d47226 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:14:33 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b240d835-8186-4928-8414-ba4137d47226 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:14:33 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b240d835-8186-4928-8414-ba4137d47226 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:14:33 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-b240d835-8186-4928-8414-ba4137d47226 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:14:34 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-b240d835-8186-4928-8414-ba4137d47226 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Getting quotas for project ed686e3b1c47423c8375a64ca9913442. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:14:34 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-b240d835-8186-4928-8414-ba4137d47226 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Getting quotas for user 018addee38464c1ba2273cbcd018400c and project ed686e3b1c47423c8375a64ca9913442. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:14:34 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-b240d835-8186-4928-8414-ba4137d47226 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Going to run 1 instances... {{(pid=61209) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 08:14:34 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-b240d835-8186-4928-8414-ba4137d47226 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] [instance: cb172aef-5c97-4c6b-85ba-f9e2608024c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b515545f-3b22-4d80-a102-6a318ab9717a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 08:14:34 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-b240d835-8186-4928-8414-ba4137d47226 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.732708 Apr 19 08:14:34 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 130/396] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 08:14:33 2023] POST /compute/v2.1/servers => generated 378 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 08:14:34 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-6adb8482-5ea7-4905-847e-9417cb65f00b tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:14:34 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-6adb8482-5ea7-4905-847e-9417cb65f00b tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] [instance: cb172aef-5c97-4c6b-85ba-f9e2608024c9] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:14:34 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-6adb8482-5ea7-4905-847e-9417cb65f00b tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018addee38464c1ba2273cbcd018400c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed686e3b1c47423c8375a64ca9913442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:14:34 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-6adb8482-5ea7-4905-847e-9417cb65f00b tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb172aef-5c97-4c6b-85ba-f9e2608024c9" status: 200 len: 1207 microversion: 2.1 time: 0.067477 Apr 19 08:14:34 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 133/397] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:14:34 2023] GET /compute/v2.1/servers/cb172aef-5c97-4c6b-85ba-f9e2608024c9 => generated 1207 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:14:34 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-19b5f60c-a4cf-47d3-83b1-d60a4eb3d967 req-5098a537-0e86-4cb7-9229-e4db2ad9612b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f04177b-d122-459b-871c-15c0964d793a", "name": "network-vif-plugged", "status": "completed", "tag": "eb1031c5-e333-4906-bb09-59f1a2ccf5a7"}, {"server_uuid": "3f04177b-d122-459b-871c-15c0964d793a", "name": "network-vif-plugged", "status": "completed", "tag": "eb1031c5-e333-4906-bb09-59f1a2ccf5a7"}, {"server_uuid": "3f04177b-d122-459b-871c-15c0964d793a", "name": "network-vif-plugged", "status": "completed", "tag": "eb1031c5-e333-4906-bb09-59f1a2ccf5a7"}, {"server_uuid": "3f04177b-d122-459b-871c-15c0964d793a", "name": "network-vif-unplugged", "status": "completed", "tag": "eb1031c5-e333-4906-bb09-59f1a2ccf5a7"}, {"server_uuid": "3f04177b-d122-459b-871c-15c0964d793a", "name": "network-vif-plugged", "status": "completed", "tag": "eb1031c5-e333-4906-bb09-59f1a2ccf5a7"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:14:34 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-19b5f60c-a4cf-47d3-83b1-d60a4eb3d967 req-5098a537-0e86-4cb7-9229-e4db2ad9612b service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:14:34 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-19b5f60c-a4cf-47d3-83b1-d60a4eb3d967 req-5098a537-0e86-4cb7-9229-e4db2ad9612b service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:14:34 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-19b5f60c-a4cf-47d3-83b1-d60a4eb3d967 req-5098a537-0e86-4cb7-9229-e4db2ad9612b service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:14:34 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-19b5f60c-a4cf-47d3-83b1-d60a4eb3d967 req-5098a537-0e86-4cb7-9229-e4db2ad9612b service nova] Creating event network-vif-plugged:eb1031c5-e333-4906-bb09-59f1a2ccf5a7 for instance 3f04177b-d122-459b-871c-15c0964d793a on user Apr 19 08:14:34 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-19b5f60c-a4cf-47d3-83b1-d60a4eb3d967 req-5098a537-0e86-4cb7-9229-e4db2ad9612b service nova] Creating event network-vif-plugged:eb1031c5-e333-4906-bb09-59f1a2ccf5a7 for instance 3f04177b-d122-459b-871c-15c0964d793a on user Apr 19 08:14:34 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-19b5f60c-a4cf-47d3-83b1-d60a4eb3d967 req-5098a537-0e86-4cb7-9229-e4db2ad9612b service nova] Creating event network-vif-plugged:eb1031c5-e333-4906-bb09-59f1a2ccf5a7 for instance 3f04177b-d122-459b-871c-15c0964d793a on user Apr 19 08:14:34 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-19b5f60c-a4cf-47d3-83b1-d60a4eb3d967 req-5098a537-0e86-4cb7-9229-e4db2ad9612b service nova] Creating event network-vif-unplugged:eb1031c5-e333-4906-bb09-59f1a2ccf5a7 for instance 3f04177b-d122-459b-871c-15c0964d793a on user Apr 19 08:14:34 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-19b5f60c-a4cf-47d3-83b1-d60a4eb3d967 req-5098a537-0e86-4cb7-9229-e4db2ad9612b service nova] Creating event network-vif-plugged:eb1031c5-e333-4906-bb09-59f1a2ccf5a7 for instance 3f04177b-d122-459b-871c-15c0964d793a on user Apr 19 08:14:34 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-19b5f60c-a4cf-47d3-83b1-d60a4eb3d967 req-5098a537-0e86-4cb7-9229-e4db2ad9612b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.035989 Apr 19 08:14:34 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 135/398] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:14:34 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:14:36 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-6184ecf0-8f1e-4eeb-be80-4b817bdc51f7 req-41159d16-b752-47d4-96cc-d781d36e1a7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb172aef-5c97-4c6b-85ba-f9e2608024c9", "tag": "2ce76215-5d37-4dae-9ade-85e8cdcdde3c"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:14:36 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-6184ecf0-8f1e-4eeb-be80-4b817bdc51f7 req-41159d16-b752-47d4-96cc-d781d36e1a7f service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:14:36 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-6184ecf0-8f1e-4eeb-be80-4b817bdc51f7 req-41159d16-b752-47d4-96cc-d781d36e1a7f service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:14:36 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-6184ecf0-8f1e-4eeb-be80-4b817bdc51f7 req-41159d16-b752-47d4-96cc-d781d36e1a7f service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:14:36 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-6184ecf0-8f1e-4eeb-be80-4b817bdc51f7 req-41159d16-b752-47d4-96cc-d781d36e1a7f service nova] Creating event network-changed:2ce76215-5d37-4dae-9ade-85e8cdcdde3c for instance cb172aef-5c97-4c6b-85ba-f9e2608024c9 on user Apr 19 08:14:36 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-6184ecf0-8f1e-4eeb-be80-4b817bdc51f7 req-41159d16-b752-47d4-96cc-d781d36e1a7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029937 Apr 19 08:14:36 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 131/399] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:14:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:14:38 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-59f575e5-d397-422c-9948-74efc6feb2ee req-c1e6e54d-913f-44d7-b329-4a24357250dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb172aef-5c97-4c6b-85ba-f9e2608024c9", "name": "network-vif-plugged", "status": "completed", "tag": "2ce76215-5d37-4dae-9ade-85e8cdcdde3c"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:14:38 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-59f575e5-d397-422c-9948-74efc6feb2ee req-c1e6e54d-913f-44d7-b329-4a24357250dc service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:14:38 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-59f575e5-d397-422c-9948-74efc6feb2ee req-c1e6e54d-913f-44d7-b329-4a24357250dc service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:14:38 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-59f575e5-d397-422c-9948-74efc6feb2ee req-c1e6e54d-913f-44d7-b329-4a24357250dc service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:14:38 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-59f575e5-d397-422c-9948-74efc6feb2ee req-c1e6e54d-913f-44d7-b329-4a24357250dc service nova] Creating event network-vif-plugged:2ce76215-5d37-4dae-9ade-85e8cdcdde3c for instance cb172aef-5c97-4c6b-85ba-f9e2608024c9 on user Apr 19 08:14:38 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-59f575e5-d397-422c-9948-74efc6feb2ee req-c1e6e54d-913f-44d7-b329-4a24357250dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029309 Apr 19 08:14:38 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 134/400] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:14:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:14:40 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-f25b7324-f59d-4953-bb2f-b6520bbf55ed req-63b6dc4e-c80f-4ed0-9713-3258e7725d66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb172aef-5c97-4c6b-85ba-f9e2608024c9", "name": "network-vif-plugged", "status": "completed", "tag": "2ce76215-5d37-4dae-9ade-85e8cdcdde3c"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:14:40 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-f25b7324-f59d-4953-bb2f-b6520bbf55ed req-63b6dc4e-c80f-4ed0-9713-3258e7725d66 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:14:40 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-f25b7324-f59d-4953-bb2f-b6520bbf55ed req-63b6dc4e-c80f-4ed0-9713-3258e7725d66 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:14:40 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-f25b7324-f59d-4953-bb2f-b6520bbf55ed req-63b6dc4e-c80f-4ed0-9713-3258e7725d66 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:14:40 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-f25b7324-f59d-4953-bb2f-b6520bbf55ed req-63b6dc4e-c80f-4ed0-9713-3258e7725d66 service nova] Creating event network-vif-plugged:2ce76215-5d37-4dae-9ade-85e8cdcdde3c for instance cb172aef-5c97-4c6b-85ba-f9e2608024c9 on user Apr 19 08:14:40 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-f25b7324-f59d-4953-bb2f-b6520bbf55ed req-63b6dc4e-c80f-4ed0-9713-3258e7725d66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028553 Apr 19 08:14:40 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 136/401] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:14:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:15:21 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:15:21 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=6 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:15:21 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:15:21 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=10 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:15:21 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-91522df9-dde4-4634-970d-454391360ca2 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:15:21 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-91522df9-dde4-4634-970d-454391360ca2 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] [instance: 3f04177b-d122-459b-871c-15c0964d793a] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:15:21 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-91522df9-dde4-4634-970d-454391360ca2 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:15:21 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-91522df9-dde4-4634-970d-454391360ca2 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:15:21 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-91522df9-dde4-4634-970d-454391360ca2 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:15:21 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-91522df9-dde4-4634-970d-454391360ca2 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:15:21 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-91522df9-dde4-4634-970d-454391360ca2 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:15:21 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-91522df9-dde4-4634-970d-454391360ca2 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:15:21 user devstack@n-api.service[61209]: INFO nova.api.openstack.wsgi [None req-91522df9-dde4-4634-970d-454391360ca2 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] HTTP exception thrown: Instance 3f04177b-d122-459b-871c-15c0964d793a could not be found. Apr 19 08:15:21 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-91522df9-dde4-4634-970d-454391360ca2 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Request method failure captured: Apr 19 08:15:21 user devstack@n-api.service[61209]: request: GET /compute/v2.1/servers/3f04177b-d122-459b-871c-15c0964d793a HTTP/1.1 Apr 19 08:15:21 user devstack@n-api.service[61209]: Accept: application/json Apr 19 08:15:21 user devstack@n-api.service[61209]: Accept-Encoding: identity Apr 19 08:15:21 user devstack@n-api.service[61209]: Connection: close Apr 19 08:15:21 user devstack@n-api.service[61209]: Content-Length: 0 Apr 19 08:15:21 user devstack@n-api.service[61209]: Content-Type: application/json Apr 19 08:15:21 user devstack@n-api.service[61209]: Host: 10.0.0.210 Apr 19 08:15:21 user devstack@n-api.service[61209]: Openstack-System-Scope: None Apr 19 08:15:21 user devstack@n-api.service[61209]: User-Agent: python-urllib3/1.26.15 Apr 19 08:15:21 user devstack@n-api.service[61209]: X-Auth-Token: gAAAAABkP6Dp-ckklASsHR16Ty1V7tF5AaUkLgi1XHB_iUkWABV1TkB4TpQkzf2iSTsseQeGeK2gtuAPoCcF1Ie_2B9XFXfoQNGiZe9mud6O87gqX4drt8Tr5iI4jC18u0EZt5ZKgabAj35kP5xKdQjnBhFPWeyepSIbrWYy3pDb-H_U9YiRHV8 Apr 19 08:15:21 user devstack@n-api.service[61209]: X-Domain-Id: None Apr 19 08:15:21 user devstack@n-api.service[61209]: X-Domain-Name: None Apr 19 08:15:21 user devstack@n-api.service[61209]: X-Identity-Status: Confirmed Apr 19 08:15:21 user devstack@n-api.service[61209]: X-Is-Admin-Project: True Apr 19 08:15:21 user devstack@n-api.service[61209]: X-Openstack-Nova-Api-Version: 2.87 Apr 19 08:15:21 user devstack@n-api.service[61209]: X-Project-Domain-Id: default Apr 19 08:15:21 user devstack@n-api.service[61209]: X-Project-Domain-Name: Default Apr 19 08:15:21 user devstack@n-api.service[61209]: X-Project-Id: 7973fa0075de42e9a74627ae9cd98d9f Apr 19 08:15:21 user devstack@n-api.service[61209]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2017668221 Apr 19 08:15:21 user devstack@n-api.service[61209]: X-Role: reader,member Apr 19 08:15:21 user devstack@n-api.service[61209]: X-Roles: reader,member Apr 19 08:15:21 user devstack@n-api.service[61209]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7973fa0075de42e9a74627ae9cd98d9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7973fa0075de42e9a74627ae9cd98d9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7973fa0075de42e9a74627ae9cd98d9f"}]}] Apr 19 08:15:21 user devstack@n-api.service[61209]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2017668221 Apr 19 08:15:21 user devstack@n-api.service[61209]: X-Tenant-Id: 7973fa0075de42e9a74627ae9cd98d9f Apr 19 08:15:21 user devstack@n-api.service[61209]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2017668221 Apr 19 08:15:21 user devstack@n-api.service[61209]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member Apr 19 08:15:21 user devstack@n-api.service[61209]: X-User-Domain-Id: default Apr 19 08:15:21 user devstack@n-api.service[61209]: X-User-Domain-Name: Default Apr 19 08:15:21 user devstack@n-api.service[61209]: X-User-Id: 5530f99504de4426ba41cfa691c430c0 Apr 19 08:15:21 user devstack@n-api.service[61209]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member Apr 19 08:15:21 user devstack@n-api.service[61209]: method: > Apr 19 08:15:21 user devstack@n-api.service[61209]: exception: Instance 3f04177b-d122-459b-871c-15c0964d793a could not be found. Apr 19 08:15:21 user devstack@n-api.service[61209]: action_args: {'id': '3f04177b-d122-459b-871c-15c0964d793a'} Apr 19 08:15:21 user devstack@n-api.service[61209]: {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f04177b-d122-459b-871c-15c0964d793a could not be found. Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f04177b-d122-459b-871c-15c0964d793a could not be found. Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f04177b-d122-459b-871c-15c0964d793a could not be found. Apr 19 08:15:21 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:15:21 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-91522df9-dde4-4634-970d-454391360ca2 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] Returning 404 to user: Instance 3f04177b-d122-459b-871c-15c0964d793a could not be found. {{(pid=61209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:15:21 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-91522df9-dde4-4634-970d-454391360ca2 tempest-ServerBootFromVolumeStableRescueTest-2017668221 tempest-ServerBootFromVolumeStableRescueTest-2017668221-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f04177b-d122-459b-871c-15c0964d793a" status: 404 len: 111 microversion: 2.87 time: 0.040693 Apr 19 08:15:21 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 132/402] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 19 08:15:21 2023] GET /compute/v2.1/servers/3f04177b-d122-459b-871c-15c0964d793a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 19 08:15:24 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:15:24 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=10 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:15:24 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=6 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:15:24 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-83d868b2-3e64-4f11-88f2-5043d0265751 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:15:24 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-83d868b2-3e64-4f11-88f2-5043d0265751 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] [instance: cb172aef-5c97-4c6b-85ba-f9e2608024c9] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:15:24 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-83d868b2-3e64-4f11-88f2-5043d0265751 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:15:24 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-83d868b2-3e64-4f11-88f2-5043d0265751 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:15:24 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-83d868b2-3e64-4f11-88f2-5043d0265751 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:15:24 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-83d868b2-3e64-4f11-88f2-5043d0265751 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:15:24 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-83d868b2-3e64-4f11-88f2-5043d0265751 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:15:24 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-83d868b2-3e64-4f11-88f2-5043d0265751 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:15:24 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-83d868b2-3e64-4f11-88f2-5043d0265751 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018addee38464c1ba2273cbcd018400c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed686e3b1c47423c8375a64ca9913442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:15:24 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-83d868b2-3e64-4f11-88f2-5043d0265751 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb172aef-5c97-4c6b-85ba-f9e2608024c9" status: 200 len: 1484 microversion: 2.1 time: 0.324424 Apr 19 08:15:24 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 135/403] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:15:24 2023] GET /compute/v2.1/servers/cb172aef-5c97-4c6b-85ba-f9e2608024c9 => generated 1484 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:15:33 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:15:33 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:15:33 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-0734f988-8f2a-4331-941d-8fc03014cd6e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Action: 'create', calling method: .version_select at 0x7f2c00eab010>, body: {"keypair": {"name": "tempest-keypair-1734847449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyMLftToQBm8DgfNoDz6vjo18cQ3/k0161uP5D9BztquARlhOzbBxHhf7k8SMwr5wRrD/fpCsuHOb+BVo6PTll6qNzwoMhS1dn8MOqGbFxQYJu4U+GpVEEdr5WZ9pZpiA=="}} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:15:33 user devstack@n-api.service[61210]: DEBUG nova.quota [None req-0734f988-8f2a-4331-941d-8fc03014cd6e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Getting quotas for project 13ff61fa1ead49a2b7003cbb642203ed. Resources: {'key_pairs'} {{(pid=61210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:15:33 user devstack@n-api.service[61210]: DEBUG nova.quota [None req-0734f988-8f2a-4331-941d-8fc03014cd6e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Getting quotas for user b0515d38f20b49b3abdbc940ca7ef30b and project 13ff61fa1ead49a2b7003cbb642203ed. Resources: {'key_pairs'} {{(pid=61210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:15:33 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-0734f988-8f2a-4331-941d-8fc03014cd6e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.184362 Apr 19 08:15:33 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 137/404] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 08:15:33 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:15:34 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-538cd525-4c56-4c26-9000-68ca0e75b9c3 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-818932230", "imageRef": "b515545f-3b22-4d80-a102-6a318ab9717a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "8bf59083-7545-420b-b6b0-4ae8510b94a2"}], "security_groups": [{"name": "tempest-securitygroup--1884595825"}], "key_name": "tempest-keypair-1734847449", "user_data": "}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:15:34 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:15:34 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:15:34 user devstack@n-api.service[61209]: DEBUG nova.network.neutron [None req-538cd525-4c56-4c26-9000-68ca0e75b9c3 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] validate_networks() for [('8bf59083-7545-420b-b6b0-4ae8510b94a2', None, None, None, None, None)] {{(pid=61209) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 08:15:35 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-538cd525-4c56-4c26-9000-68ca0e75b9c3 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Flavor limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 08:15:35 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-538cd525-4c56-4c26-9000-68ca0e75b9c3 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Image limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 08:15:35 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-538cd525-4c56-4c26-9000-68ca0e75b9c3 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Flavor pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 08:15:35 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-538cd525-4c56-4c26-9000-68ca0e75b9c3 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Image pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 08:15:35 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-538cd525-4c56-4c26-9000-68ca0e75b9c3 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 08:15:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-538cd525-4c56-4c26-9000-68ca0e75b9c3 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:15:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-538cd525-4c56-4c26-9000-68ca0e75b9c3 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:15:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-538cd525-4c56-4c26-9000-68ca0e75b9c3 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:15:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-538cd525-4c56-4c26-9000-68ca0e75b9c3 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:15:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-538cd525-4c56-4c26-9000-68ca0e75b9c3 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:15:35 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-538cd525-4c56-4c26-9000-68ca0e75b9c3 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:15:35 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-538cd525-4c56-4c26-9000-68ca0e75b9c3 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Getting quotas for project 13ff61fa1ead49a2b7003cbb642203ed. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:15:35 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-538cd525-4c56-4c26-9000-68ca0e75b9c3 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Getting quotas for user b0515d38f20b49b3abdbc940ca7ef30b and project 13ff61fa1ead49a2b7003cbb642203ed. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:15:35 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-538cd525-4c56-4c26-9000-68ca0e75b9c3 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Going to run 1 instances... {{(pid=61209) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 08:15:35 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-538cd525-4c56-4c26-9000-68ca0e75b9c3 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b515545f-3b22-4d80-a102-6a318ab9717a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 08:15:35 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-538cd525-4c56-4c26-9000-68ca0e75b9c3 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.866244 Apr 19 08:15:35 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 133/405] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 08:15:34 2023] POST /compute/v2.1/servers => generated 400 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 08:15:35 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-bac0b9e4-9920-4153-aac4-dd7db2c27e5d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:15:35 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-bac0b9e4-9920-4153-aac4-dd7db2c27e5d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:15:35 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:15:35 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=6 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:15:35 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-bac0b9e4-9920-4153-aac4-dd7db2c27e5d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0515d38f20b49b3abdbc940ca7ef30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ff61fa1ead49a2b7003cbb642203ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:15:35 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-bac0b9e4-9920-4153-aac4-dd7db2c27e5d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cd895f2-ebfe-4a0d-84c7-c617d89b88a8" status: 200 len: 1235 microversion: 2.1 time: 0.070679 Apr 19 08:15:35 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 136/406] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:15:35 2023] GET /compute/v2.1/servers/0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 => generated 1235 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:15:38 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-5f7d9a7e-e681-4223-86a7-cedd8937da04 req-f4fd60e3-8eb7-4962-9bcc-7fc3f529e056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd895f2-ebfe-4a0d-84c7-c617d89b88a8", "tag": "b78002e2-6e02-46f6-9abe-5afe5e1945d6"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:15:38 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-5f7d9a7e-e681-4223-86a7-cedd8937da04 req-f4fd60e3-8eb7-4962-9bcc-7fc3f529e056 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:15:38 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-5f7d9a7e-e681-4223-86a7-cedd8937da04 req-f4fd60e3-8eb7-4962-9bcc-7fc3f529e056 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:15:38 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-5f7d9a7e-e681-4223-86a7-cedd8937da04 req-f4fd60e3-8eb7-4962-9bcc-7fc3f529e056 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:15:38 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-5f7d9a7e-e681-4223-86a7-cedd8937da04 req-f4fd60e3-8eb7-4962-9bcc-7fc3f529e056 service nova] Creating event network-changed:b78002e2-6e02-46f6-9abe-5afe5e1945d6 for instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 on user Apr 19 08:15:38 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-5f7d9a7e-e681-4223-86a7-cedd8937da04 req-f4fd60e3-8eb7-4962-9bcc-7fc3f529e056 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098054 Apr 19 08:15:38 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 138/407] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:15:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 08:15:40 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-639453cf-6df8-4b8c-b83b-0b297bdc0081 req-ffa53c23-9aab-447f-81c7-c6dd9055c493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd895f2-ebfe-4a0d-84c7-c617d89b88a8", "name": "network-vif-plugged", "status": "completed", "tag": "b78002e2-6e02-46f6-9abe-5afe5e1945d6"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:15:40 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-639453cf-6df8-4b8c-b83b-0b297bdc0081 req-ffa53c23-9aab-447f-81c7-c6dd9055c493 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:15:40 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-639453cf-6df8-4b8c-b83b-0b297bdc0081 req-ffa53c23-9aab-447f-81c7-c6dd9055c493 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:15:40 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-639453cf-6df8-4b8c-b83b-0b297bdc0081 req-ffa53c23-9aab-447f-81c7-c6dd9055c493 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:15:40 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-639453cf-6df8-4b8c-b83b-0b297bdc0081 req-ffa53c23-9aab-447f-81c7-c6dd9055c493 service nova] Creating event network-vif-plugged:b78002e2-6e02-46f6-9abe-5afe5e1945d6 for instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 on user Apr 19 08:15:40 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-639453cf-6df8-4b8c-b83b-0b297bdc0081 req-ffa53c23-9aab-447f-81c7-c6dd9055c493 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134600 Apr 19 08:15:40 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 134/408] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:15:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:15:42 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-31fd4648-b642-483b-9593-9cb0458774c3 req-a0697ae3-e6e3-4f0e-a9a3-4e7a014987de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd895f2-ebfe-4a0d-84c7-c617d89b88a8", "name": "network-vif-plugged", "status": "completed", "tag": "b78002e2-6e02-46f6-9abe-5afe5e1945d6"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:15:42 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-31fd4648-b642-483b-9593-9cb0458774c3 req-a0697ae3-e6e3-4f0e-a9a3-4e7a014987de service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:15:42 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-31fd4648-b642-483b-9593-9cb0458774c3 req-a0697ae3-e6e3-4f0e-a9a3-4e7a014987de service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:15:42 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-31fd4648-b642-483b-9593-9cb0458774c3 req-a0697ae3-e6e3-4f0e-a9a3-4e7a014987de service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:15:42 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-31fd4648-b642-483b-9593-9cb0458774c3 req-a0697ae3-e6e3-4f0e-a9a3-4e7a014987de service nova] Creating event network-vif-plugged:b78002e2-6e02-46f6-9abe-5afe5e1945d6 for instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 on user Apr 19 08:15:42 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-31fd4648-b642-483b-9593-9cb0458774c3 req-a0697ae3-e6e3-4f0e-a9a3-4e7a014987de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028608 Apr 19 08:15:42 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 137/409] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:15:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:16:25 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell0:SELECT=4 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:16:25 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:16:25 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=2 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:16:25 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-acd4249d-7e3b-4ade-8ae9-33427f72abe7 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:16:25 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-acd4249d-7e3b-4ade-8ae9-33427f72abe7 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:16:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-acd4249d-7e3b-4ade-8ae9-33427f72abe7 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:16:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-acd4249d-7e3b-4ade-8ae9-33427f72abe7 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:16:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-acd4249d-7e3b-4ade-8ae9-33427f72abe7 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:16:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-acd4249d-7e3b-4ade-8ae9-33427f72abe7 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:16:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-acd4249d-7e3b-4ade-8ae9-33427f72abe7 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:16:25 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-acd4249d-7e3b-4ade-8ae9-33427f72abe7 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:16:25 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-acd4249d-7e3b-4ade-8ae9-33427f72abe7 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0515d38f20b49b3abdbc940ca7ef30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ff61fa1ead49a2b7003cbb642203ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:16:25 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-acd4249d-7e3b-4ade-8ae9-33427f72abe7 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cd895f2-ebfe-4a0d-84c7-c617d89b88a8" status: 200 len: 1545 microversion: 2.1 time: 0.297223 Apr 19 08:16:25 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 139/410] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:16:25 2023] GET /compute/v2.1/servers/0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 => generated 1545 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:16:26 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:16:26 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=6 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:16:26 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:16:26 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=4 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:16:26 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-7aa69020-742a-432c-9c86-f7f82ecb4316 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:16:26 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-7aa69020-742a-432c-9c86-f7f82ecb4316 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] [instance: cb172aef-5c97-4c6b-85ba-f9e2608024c9] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:16:26 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-7aa69020-742a-432c-9c86-f7f82ecb4316 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:16:26 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-7aa69020-742a-432c-9c86-f7f82ecb4316 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:16:26 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-7aa69020-742a-432c-9c86-f7f82ecb4316 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:16:26 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-7aa69020-742a-432c-9c86-f7f82ecb4316 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:16:26 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-7aa69020-742a-432c-9c86-f7f82ecb4316 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:16:26 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-7aa69020-742a-432c-9c86-f7f82ecb4316 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:16:26 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-7aa69020-742a-432c-9c86-f7f82ecb4316 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] [instance: cb172aef-5c97-4c6b-85ba-f9e2608024c9] Going to try to terminate instance {{(pid=61209) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:16:26 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-7aa69020-742a-432c-9c86-f7f82ecb4316 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cb172aef-5c97-4c6b-85ba-f9e2608024c9" status: 204 len: 0 microversion: 2.1 time: 0.157855 Apr 19 08:16:26 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 135/411] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:16:26 2023] DELETE /compute/v2.1/servers/cb172aef-5c97-4c6b-85ba-f9e2608024c9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 08:16:26 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:16:26 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=6 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:16:26 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:16:26 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-eb964e2c-5c87-478e-bad8-50dbfe4f0c19 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:16:26 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-eb964e2c-5c87-478e-bad8-50dbfe4f0c19 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] [instance: cb172aef-5c97-4c6b-85ba-f9e2608024c9] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:16:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-eb964e2c-5c87-478e-bad8-50dbfe4f0c19 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:16:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-eb964e2c-5c87-478e-bad8-50dbfe4f0c19 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:16:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-eb964e2c-5c87-478e-bad8-50dbfe4f0c19 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:16:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-eb964e2c-5c87-478e-bad8-50dbfe4f0c19 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:16:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-eb964e2c-5c87-478e-bad8-50dbfe4f0c19 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:16:26 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-eb964e2c-5c87-478e-bad8-50dbfe4f0c19 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:16:26 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-eb964e2c-5c87-478e-bad8-50dbfe4f0c19 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '018addee38464c1ba2273cbcd018400c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed686e3b1c47423c8375a64ca9913442', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:16:26 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-eb964e2c-5c87-478e-bad8-50dbfe4f0c19 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb172aef-5c97-4c6b-85ba-f9e2608024c9" status: 200 len: 1490 microversion: 2.1 time: 0.325239 Apr 19 08:16:26 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 138/412] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:16:26 2023] GET /compute/v2.1/servers/cb172aef-5c97-4c6b-85ba-f9e2608024c9 => generated 1490 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:16:26 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-3473a4a2-efaf-4c06-bd5b-afb1b074cd06 req-d9dccc63-ae13-4c38-a226-b2ce6144c026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb172aef-5c97-4c6b-85ba-f9e2608024c9", "name": "network-vif-unplugged", "status": "completed", "tag": "2ce76215-5d37-4dae-9ade-85e8cdcdde3c"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:16:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-3473a4a2-efaf-4c06-bd5b-afb1b074cd06 req-d9dccc63-ae13-4c38-a226-b2ce6144c026 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:16:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-3473a4a2-efaf-4c06-bd5b-afb1b074cd06 req-d9dccc63-ae13-4c38-a226-b2ce6144c026 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:16:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-3473a4a2-efaf-4c06-bd5b-afb1b074cd06 req-d9dccc63-ae13-4c38-a226-b2ce6144c026 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:16:26 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-3473a4a2-efaf-4c06-bd5b-afb1b074cd06 req-d9dccc63-ae13-4c38-a226-b2ce6144c026 service nova] Creating event network-vif-unplugged:2ce76215-5d37-4dae-9ade-85e8cdcdde3c for instance cb172aef-5c97-4c6b-85ba-f9e2608024c9 on user Apr 19 08:16:26 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-3473a4a2-efaf-4c06-bd5b-afb1b074cd06 req-d9dccc63-ae13-4c38-a226-b2ce6144c026 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027243 Apr 19 08:16:26 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 140/413] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:16:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:16:28 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-0e0fc393-cba5-45a0-a62a-2ebf474b2ffd req-261d73a9-9746-40d9-a395-3684231810b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb172aef-5c97-4c6b-85ba-f9e2608024c9", "name": "network-vif-plugged", "status": "completed", "tag": "2ce76215-5d37-4dae-9ade-85e8cdcdde3c"}, {"server_uuid": "cb172aef-5c97-4c6b-85ba-f9e2608024c9", "name": "network-vif-deleted", "tag": "2ce76215-5d37-4dae-9ade-85e8cdcdde3c"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:16:28 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-0e0fc393-cba5-45a0-a62a-2ebf474b2ffd req-261d73a9-9746-40d9-a395-3684231810b8 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:16:28 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-0e0fc393-cba5-45a0-a62a-2ebf474b2ffd req-261d73a9-9746-40d9-a395-3684231810b8 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:16:28 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-0e0fc393-cba5-45a0-a62a-2ebf474b2ffd req-261d73a9-9746-40d9-a395-3684231810b8 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:16:28 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-0e0fc393-cba5-45a0-a62a-2ebf474b2ffd req-261d73a9-9746-40d9-a395-3684231810b8 service nova] Creating event network-vif-plugged:2ce76215-5d37-4dae-9ade-85e8cdcdde3c for instance cb172aef-5c97-4c6b-85ba-f9e2608024c9 on user Apr 19 08:16:28 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-0e0fc393-cba5-45a0-a62a-2ebf474b2ffd req-261d73a9-9746-40d9-a395-3684231810b8 service nova] Creating event network-vif-deleted:2ce76215-5d37-4dae-9ade-85e8cdcdde3c for instance cb172aef-5c97-4c6b-85ba-f9e2608024c9 on user Apr 19 08:16:28 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-0e0fc393-cba5-45a0-a62a-2ebf474b2ffd req-261d73a9-9746-40d9-a395-3684231810b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033869 Apr 19 08:16:28 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 136/414] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:16:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:17:16 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-b5483e59-13ed-4e78-8e2e-41ed2bc6f035 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:17:16 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-b5483e59-13ed-4e78-8e2e-41ed2bc6f035 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] [instance: cb172aef-5c97-4c6b-85ba-f9e2608024c9] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:17:16 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:17:16 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=6 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:17:16 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b5483e59-13ed-4e78-8e2e-41ed2bc6f035 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:17:16 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b5483e59-13ed-4e78-8e2e-41ed2bc6f035 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:17:16 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b5483e59-13ed-4e78-8e2e-41ed2bc6f035 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:17:16 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b5483e59-13ed-4e78-8e2e-41ed2bc6f035 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:17:16 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b5483e59-13ed-4e78-8e2e-41ed2bc6f035 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:17:16 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-b5483e59-13ed-4e78-8e2e-41ed2bc6f035 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:17:16 user devstack@n-api.service[61208]: INFO nova.api.openstack.wsgi [None req-b5483e59-13ed-4e78-8e2e-41ed2bc6f035 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] HTTP exception thrown: Instance cb172aef-5c97-4c6b-85ba-f9e2608024c9 could not be found. Apr 19 08:17:16 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-b5483e59-13ed-4e78-8e2e-41ed2bc6f035 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Request method failure captured: Apr 19 08:17:16 user devstack@n-api.service[61208]: request: GET /compute/v2.1/servers/cb172aef-5c97-4c6b-85ba-f9e2608024c9 HTTP/1.1 Apr 19 08:17:16 user devstack@n-api.service[61208]: Accept: application/json Apr 19 08:17:16 user devstack@n-api.service[61208]: Accept-Encoding: identity Apr 19 08:17:16 user devstack@n-api.service[61208]: Connection: close Apr 19 08:17:16 user devstack@n-api.service[61208]: Content-Length: 0 Apr 19 08:17:16 user devstack@n-api.service[61208]: Content-Type: application/json Apr 19 08:17:16 user devstack@n-api.service[61208]: Host: 10.0.0.210 Apr 19 08:17:16 user devstack@n-api.service[61208]: Openstack-System-Scope: None Apr 19 08:17:16 user devstack@n-api.service[61208]: User-Agent: python-urllib3/1.26.15 Apr 19 08:17:16 user devstack@n-api.service[61208]: X-Auth-Token: gAAAAABkP6LnRfjJOt4GQ0kkZZ9BcreKXZdCQ5sVierJ9D84gsXooekKea5DxbiTu45VHQzDgLMMyzB2nDR0xDmYpzz0AViT9j4ohUPU4OXD1onU2OeajbcZNom7uriorhf0AbsoUR66ZKXfmFEaTUzWqvGs1XseLGlse47Ae3-qgzq5wCfzeQo Apr 19 08:17:16 user devstack@n-api.service[61208]: X-Domain-Id: None Apr 19 08:17:16 user devstack@n-api.service[61208]: X-Domain-Name: None Apr 19 08:17:16 user devstack@n-api.service[61208]: X-Identity-Status: Confirmed Apr 19 08:17:16 user devstack@n-api.service[61208]: X-Is-Admin-Project: True Apr 19 08:17:16 user devstack@n-api.service[61208]: X-Project-Domain-Id: default Apr 19 08:17:16 user devstack@n-api.service[61208]: X-Project-Domain-Name: Default Apr 19 08:17:16 user devstack@n-api.service[61208]: X-Project-Id: ed686e3b1c47423c8375a64ca9913442 Apr 19 08:17:16 user devstack@n-api.service[61208]: X-Project-Name: tempest-VolumesActionsTest-881484216 Apr 19 08:17:16 user devstack@n-api.service[61208]: X-Role: reader,member Apr 19 08:17:16 user devstack@n-api.service[61208]: X-Roles: reader,member Apr 19 08:17:16 user devstack@n-api.service[61208]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ed686e3b1c47423c8375a64ca9913442"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ed686e3b1c47423c8375a64ca9913442"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ed686e3b1c47423c8375a64ca9913442"}]}] Apr 19 08:17:16 user devstack@n-api.service[61208]: X-Tenant: tempest-VolumesActionsTest-881484216 Apr 19 08:17:16 user devstack@n-api.service[61208]: X-Tenant-Id: ed686e3b1c47423c8375a64ca9913442 Apr 19 08:17:16 user devstack@n-api.service[61208]: X-Tenant-Name: tempest-VolumesActionsTest-881484216 Apr 19 08:17:16 user devstack@n-api.service[61208]: X-User: tempest-VolumesActionsTest-881484216-project-member Apr 19 08:17:16 user devstack@n-api.service[61208]: X-User-Domain-Id: default Apr 19 08:17:16 user devstack@n-api.service[61208]: X-User-Domain-Name: Default Apr 19 08:17:16 user devstack@n-api.service[61208]: X-User-Id: 018addee38464c1ba2273cbcd018400c Apr 19 08:17:16 user devstack@n-api.service[61208]: X-User-Name: tempest-VolumesActionsTest-881484216-project-member Apr 19 08:17:16 user devstack@n-api.service[61208]: method: > Apr 19 08:17:16 user devstack@n-api.service[61208]: exception: Instance cb172aef-5c97-4c6b-85ba-f9e2608024c9 could not be found. Apr 19 08:17:16 user devstack@n-api.service[61208]: action_args: {'id': 'cb172aef-5c97-4c6b-85ba-f9e2608024c9'} Apr 19 08:17:16 user devstack@n-api.service[61208]: {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb172aef-5c97-4c6b-85ba-f9e2608024c9 could not be found. Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb172aef-5c97-4c6b-85ba-f9e2608024c9 could not be found. Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb172aef-5c97-4c6b-85ba-f9e2608024c9 could not be found. Apr 19 08:17:16 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:17:16 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-b5483e59-13ed-4e78-8e2e-41ed2bc6f035 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] Returning 404 to user: Instance cb172aef-5c97-4c6b-85ba-f9e2608024c9 could not be found. {{(pid=61208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:17:16 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-b5483e59-13ed-4e78-8e2e-41ed2bc6f035 tempest-VolumesActionsTest-881484216 tempest-VolumesActionsTest-881484216-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb172aef-5c97-4c6b-85ba-f9e2608024c9" status: 404 len: 111 microversion: 2.1 time: 0.040897 Apr 19 08:17:16 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 139/415] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:17:16 2023] GET /compute/v2.1/servers/cb172aef-5c97-4c6b-85ba-f9e2608024c9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:17:26 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=4 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:17:26 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=8 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:17:26 user devstack@n-api.service[61210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 08:17:26 user devstack@n-api.service[61210]: Wed Apr 19 08:17:26 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0cd895f2-ebfe-4a0d-84c7-c617d89b88a8/os-interface (ip 10.0.0.210) !!! Apr 19 08:17:26 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-95683dff-ea4d-4d9a-8264-ebecd4cc7155 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:17:26 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-95683dff-ea4d-4d9a-8264-ebecd4cc7155 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:17:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-95683dff-ea4d-4d9a-8264-ebecd4cc7155 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:17:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-95683dff-ea4d-4d9a-8264-ebecd4cc7155 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:17:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-95683dff-ea4d-4d9a-8264-ebecd4cc7155 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:17:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-95683dff-ea4d-4d9a-8264-ebecd4cc7155 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:17:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-95683dff-ea4d-4d9a-8264-ebecd4cc7155 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:17:26 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-95683dff-ea4d-4d9a-8264-ebecd4cc7155 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:17:26 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-95683dff-ea4d-4d9a-8264-ebecd4cc7155 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cd895f2-ebfe-4a0d-84c7-c617d89b88a8/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.171720 Apr 19 08:17:26 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 141/416] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 08:17:26 2023] GET /compute/v2.1/servers/0cd895f2-ebfe-4a0d-84c7-c617d89b88a8/os-interface => generated 283 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:17:27 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:17:27 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:17:27 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-6e13db06-6267-4770-8556-04677a59e4df req-263f217a-4209-4d90-a4fc-eb371e11a74f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd895f2-ebfe-4a0d-84c7-c617d89b88a8", "tag": "b78002e2-6e02-46f6-9abe-5afe5e1945d6"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:17:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-6e13db06-6267-4770-8556-04677a59e4df req-263f217a-4209-4d90-a4fc-eb371e11a74f service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:17:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-6e13db06-6267-4770-8556-04677a59e4df req-263f217a-4209-4d90-a4fc-eb371e11a74f service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:17:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-6e13db06-6267-4770-8556-04677a59e4df req-263f217a-4209-4d90-a4fc-eb371e11a74f service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:17:27 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-6e13db06-6267-4770-8556-04677a59e4df req-263f217a-4209-4d90-a4fc-eb371e11a74f service nova] Creating event network-changed:b78002e2-6e02-46f6-9abe-5afe5e1945d6 for instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 on user Apr 19 08:17:27 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-6e13db06-6267-4770-8556-04677a59e4df req-263f217a-4209-4d90-a4fc-eb371e11a74f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043935 Apr 19 08:17:27 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 137/417] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:17:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:17:27 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-989a0cfd-fc2e-45f2-8f0d-8ef2f72c287b tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:17:27 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-989a0cfd-fc2e-45f2-8f0d-8ef2f72c287b tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:17:27 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:17:27 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:17:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-989a0cfd-fc2e-45f2-8f0d-8ef2f72c287b tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:17:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-989a0cfd-fc2e-45f2-8f0d-8ef2f72c287b tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:17:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-989a0cfd-fc2e-45f2-8f0d-8ef2f72c287b tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:17:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-989a0cfd-fc2e-45f2-8f0d-8ef2f72c287b tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:17:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-989a0cfd-fc2e-45f2-8f0d-8ef2f72c287b tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:17:27 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-989a0cfd-fc2e-45f2-8f0d-8ef2f72c287b tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:17:27 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-989a0cfd-fc2e-45f2-8f0d-8ef2f72c287b tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cd895f2-ebfe-4a0d-84c7-c617d89b88a8/ips" status: 200 len: 108 microversion: 2.1 time: 0.041932 Apr 19 08:17:27 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 140/418] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 08:17:27 2023] GET /compute/v2.1/servers/0cd895f2-ebfe-4a0d-84c7-c617d89b88a8/ips => generated 108 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:17:28 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-10349ff8-0a94-4255-855a-4999a8a206e8 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:17:28 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-10349ff8-0a94-4255-855a-4999a8a206e8 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:17:28 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-10349ff8-0a94-4255-855a-4999a8a206e8 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:17:28 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-10349ff8-0a94-4255-855a-4999a8a206e8 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:17:28 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-10349ff8-0a94-4255-855a-4999a8a206e8 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:17:28 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-10349ff8-0a94-4255-855a-4999a8a206e8 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:17:28 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-10349ff8-0a94-4255-855a-4999a8a206e8 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:17:28 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-10349ff8-0a94-4255-855a-4999a8a206e8 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:17:28 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-10349ff8-0a94-4255-855a-4999a8a206e8 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8] Going to try to terminate instance {{(pid=61210) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:17:29 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-10349ff8-0a94-4255-855a-4999a8a206e8 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0cd895f2-ebfe-4a0d-84c7-c617d89b88a8" status: 204 len: 0 microversion: 2.1 time: 0.184670 Apr 19 08:17:29 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 142/419] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:17:28 2023] DELETE /compute/v2.1/servers/0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 08:17:29 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-5f4d5531-51e2-452f-9083-c341ccbc1b15 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:17:29 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-5f4d5531-51e2-452f-9083-c341ccbc1b15 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:17:29 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5f4d5531-51e2-452f-9083-c341ccbc1b15 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:17:29 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5f4d5531-51e2-452f-9083-c341ccbc1b15 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:17:29 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5f4d5531-51e2-452f-9083-c341ccbc1b15 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:17:29 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5f4d5531-51e2-452f-9083-c341ccbc1b15 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:17:29 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5f4d5531-51e2-452f-9083-c341ccbc1b15 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:17:29 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-5f4d5531-51e2-452f-9083-c341ccbc1b15 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:17:29 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-c0a3183a-a43b-4d94-a5e3-4d118479ed97 req-d3bcd5b7-6105-480d-a07f-f46436eb4476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd895f2-ebfe-4a0d-84c7-c617d89b88a8", "name": "network-vif-unplugged", "status": "completed", "tag": "b78002e2-6e02-46f6-9abe-5afe5e1945d6"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:17:29 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-c0a3183a-a43b-4d94-a5e3-4d118479ed97 req-d3bcd5b7-6105-480d-a07f-f46436eb4476 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:17:29 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-c0a3183a-a43b-4d94-a5e3-4d118479ed97 req-d3bcd5b7-6105-480d-a07f-f46436eb4476 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:17:29 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-c0a3183a-a43b-4d94-a5e3-4d118479ed97 req-d3bcd5b7-6105-480d-a07f-f46436eb4476 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:17:29 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-c0a3183a-a43b-4d94-a5e3-4d118479ed97 req-d3bcd5b7-6105-480d-a07f-f46436eb4476 service nova] Creating event network-vif-unplugged:b78002e2-6e02-46f6-9abe-5afe5e1945d6 for instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 on user Apr 19 08:17:29 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-c0a3183a-a43b-4d94-a5e3-4d118479ed97 req-d3bcd5b7-6105-480d-a07f-f46436eb4476 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034537 Apr 19 08:17:29 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 141/420] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:17:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:17:29 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-5f4d5531-51e2-452f-9083-c341ccbc1b15 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0515d38f20b49b3abdbc940ca7ef30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ff61fa1ead49a2b7003cbb642203ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:17:29 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-5f4d5531-51e2-452f-9083-c341ccbc1b15 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cd895f2-ebfe-4a0d-84c7-c617d89b88a8" status: 200 len: 1670 microversion: 2.1 time: 0.399889 Apr 19 08:17:29 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 138/421] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:17:29 2023] GET /compute/v2.1/servers/0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 => generated 1670 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:17:31 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-033d5964-492f-489a-86d9-0307c76a9eb8 req-adb33392-762e-4ac1-bf7c-8675b686ed7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd895f2-ebfe-4a0d-84c7-c617d89b88a8", "name": "network-vif-deleted", "tag": "b78002e2-6e02-46f6-9abe-5afe5e1945d6"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:17:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-033d5964-492f-489a-86d9-0307c76a9eb8 req-adb33392-762e-4ac1-bf7c-8675b686ed7e service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:17:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-033d5964-492f-489a-86d9-0307c76a9eb8 req-adb33392-762e-4ac1-bf7c-8675b686ed7e service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:17:31 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-033d5964-492f-489a-86d9-0307c76a9eb8 req-adb33392-762e-4ac1-bf7c-8675b686ed7e service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:17:31 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-033d5964-492f-489a-86d9-0307c76a9eb8 req-adb33392-762e-4ac1-bf7c-8675b686ed7e service nova] Creating event network-vif-deleted:b78002e2-6e02-46f6-9abe-5afe5e1945d6 for instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 on user Apr 19 08:17:31 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-033d5964-492f-489a-86d9-0307c76a9eb8 req-adb33392-762e-4ac1-bf7c-8675b686ed7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028253 Apr 19 08:17:31 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 143/422] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:17:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:17:31 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-a07041cc-c84c-46af-8950-ac1a457f87d7 req-1934639a-2bd6-4e88-ac03-70f03af0da01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd895f2-ebfe-4a0d-84c7-c617d89b88a8", "name": "network-vif-plugged", "status": "completed", "tag": "b78002e2-6e02-46f6-9abe-5afe5e1945d6"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:17:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-a07041cc-c84c-46af-8950-ac1a457f87d7 req-1934639a-2bd6-4e88-ac03-70f03af0da01 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:17:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-a07041cc-c84c-46af-8950-ac1a457f87d7 req-1934639a-2bd6-4e88-ac03-70f03af0da01 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:17:31 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-a07041cc-c84c-46af-8950-ac1a457f87d7 req-1934639a-2bd6-4e88-ac03-70f03af0da01 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:17:31 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-a07041cc-c84c-46af-8950-ac1a457f87d7 req-1934639a-2bd6-4e88-ac03-70f03af0da01 service nova] Creating event network-vif-plugged:b78002e2-6e02-46f6-9abe-5afe5e1945d6 for instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 on user Apr 19 08:17:31 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-a07041cc-c84c-46af-8950-ac1a457f87d7 req-1934639a-2bd6-4e88-ac03-70f03af0da01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031560 Apr 19 08:17:31 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 142/423] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:17:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:18:19 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-70eb2495-f408-4924-a0ed-119575780f83 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:18:19 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-70eb2495-f408-4924-a0ed-119575780f83 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:18:19 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=4 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:18:19 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=8 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:18:19 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-70eb2495-f408-4924-a0ed-119575780f83 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:18:19 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-70eb2495-f408-4924-a0ed-119575780f83 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:18:19 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-70eb2495-f408-4924-a0ed-119575780f83 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:18:19 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-70eb2495-f408-4924-a0ed-119575780f83 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:18:19 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-70eb2495-f408-4924-a0ed-119575780f83 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:18:19 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-70eb2495-f408-4924-a0ed-119575780f83 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:18:19 user devstack@n-api.service[61209]: INFO nova.api.openstack.wsgi [None req-70eb2495-f408-4924-a0ed-119575780f83 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] HTTP exception thrown: Instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 could not be found. Apr 19 08:18:19 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-70eb2495-f408-4924-a0ed-119575780f83 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Request method failure captured: Apr 19 08:18:19 user devstack@n-api.service[61209]: request: GET /compute/v2.1/servers/0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 HTTP/1.1 Apr 19 08:18:19 user devstack@n-api.service[61209]: Accept: application/json Apr 19 08:18:19 user devstack@n-api.service[61209]: Accept-Encoding: identity Apr 19 08:18:19 user devstack@n-api.service[61209]: Connection: close Apr 19 08:18:19 user devstack@n-api.service[61209]: Content-Length: 0 Apr 19 08:18:19 user devstack@n-api.service[61209]: Content-Type: application/json Apr 19 08:18:19 user devstack@n-api.service[61209]: Host: 10.0.0.210 Apr 19 08:18:19 user devstack@n-api.service[61209]: Openstack-System-Scope: None Apr 19 08:18:19 user devstack@n-api.service[61209]: User-Agent: python-urllib3/1.26.15 Apr 19 08:18:19 user devstack@n-api.service[61209]: X-Auth-Token: gAAAAABkP6Ml6AVFrdZmwG6v9Ak3nCCxOWNoGRyfAY9VXfGPn2QRTKj8vAEzIe-ofIP9WqCqx0spEaxwaexIys1H26tCx3kz4GWtv8Xu-fJN6P665TCoRMxFVlmLehXlVDrwWQkUD447jYgz_ODpB5iqaKc80Q8eZ0hryuWlvyy82V75C3ahBos Apr 19 08:18:19 user devstack@n-api.service[61209]: X-Domain-Id: None Apr 19 08:18:19 user devstack@n-api.service[61209]: X-Domain-Name: None Apr 19 08:18:19 user devstack@n-api.service[61209]: X-Identity-Status: Confirmed Apr 19 08:18:19 user devstack@n-api.service[61209]: X-Is-Admin-Project: True Apr 19 08:18:19 user devstack@n-api.service[61209]: X-Project-Domain-Id: default Apr 19 08:18:19 user devstack@n-api.service[61209]: X-Project-Domain-Name: Default Apr 19 08:18:19 user devstack@n-api.service[61209]: X-Project-Id: 13ff61fa1ead49a2b7003cbb642203ed Apr 19 08:18:19 user devstack@n-api.service[61209]: X-Project-Name: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:18:19 user devstack@n-api.service[61209]: X-Role: reader,member Apr 19 08:18:19 user devstack@n-api.service[61209]: X-Roles: reader,member Apr 19 08:18:19 user devstack@n-api.service[61209]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13ff61fa1ead49a2b7003cbb642203ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13ff61fa1ead49a2b7003cbb642203ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13ff61fa1ead49a2b7003cbb642203ed"}]}] Apr 19 08:18:19 user devstack@n-api.service[61209]: X-Tenant: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:18:19 user devstack@n-api.service[61209]: X-Tenant-Id: 13ff61fa1ead49a2b7003cbb642203ed Apr 19 08:18:19 user devstack@n-api.service[61209]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:18:19 user devstack@n-api.service[61209]: X-User: tempest-AttachVolumeNegativeTest-172980430-project-member Apr 19 08:18:19 user devstack@n-api.service[61209]: X-User-Domain-Id: default Apr 19 08:18:19 user devstack@n-api.service[61209]: X-User-Domain-Name: Default Apr 19 08:18:19 user devstack@n-api.service[61209]: X-User-Id: b0515d38f20b49b3abdbc940ca7ef30b Apr 19 08:18:19 user devstack@n-api.service[61209]: X-User-Name: tempest-AttachVolumeNegativeTest-172980430-project-member Apr 19 08:18:19 user devstack@n-api.service[61209]: method: > Apr 19 08:18:19 user devstack@n-api.service[61209]: exception: Instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 could not be found. Apr 19 08:18:19 user devstack@n-api.service[61209]: action_args: {'id': '0cd895f2-ebfe-4a0d-84c7-c617d89b88a8'} Apr 19 08:18:19 user devstack@n-api.service[61209]: {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 could not be found. Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 could not be found. Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 could not be found. Apr 19 08:18:19 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:18:19 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-70eb2495-f408-4924-a0ed-119575780f83 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Returning 404 to user: Instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 could not be found. {{(pid=61209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:18:19 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-70eb2495-f408-4924-a0ed-119575780f83 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cd895f2-ebfe-4a0d-84c7-c617d89b88a8" status: 404 len: 111 microversion: 2.1 time: 0.035538 Apr 19 08:18:19 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 139/424] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:18:19 2023] GET /compute/v2.1/servers/0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:18:19 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:18:19 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:18:19 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-7fadf5cc-be13-4344-8e18-9bf0f4fd9648 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '.version_select at 0x7f2c00eab130>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:18:19 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-7fadf5cc-be13-4344-8e18-9bf0f4fd9648 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1734847449" status: 202 len: 0 microversion: 2.1 time: 0.031970 Apr 19 08:18:19 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 144/425] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 08:18:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1734847449 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 08:18:20 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=6 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:18:20 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=8 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:18:20 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-a006834c-1aea-4c78-b7a4-888a64ce51c6 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Action: 'create', calling method: .version_select at 0x7f2c00e581f0>, body: {"keypair": {"name": "tempest-keypair-1224695615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHVBVRka/0VLRjvoeWDrIMHAYpeslXybjTPsEsjxgsGieLtnLU9YJU6oDZheeQ1Vg/iWiVGdJKnOoFZPiDn5QvMZoTURcmsKt0z24dRjrwcBftm4ckkeIRk8TXbiXH2Cw=="}} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:18:20 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-a006834c-1aea-4c78-b7a4-888a64ce51c6 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Getting quotas for project 13ff61fa1ead49a2b7003cbb642203ed. Resources: {'key_pairs'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:18:20 user devstack@n-api.service[61208]: DEBUG nova.quota [None req-a006834c-1aea-4c78-b7a4-888a64ce51c6 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Getting quotas for user b0515d38f20b49b3abdbc940ca7ef30b and project 13ff61fa1ead49a2b7003cbb642203ed. Resources: {'key_pairs'} {{(pid=61208) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:18:20 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-a006834c-1aea-4c78-b7a4-888a64ce51c6 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049486 Apr 19 08:18:20 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 143/426] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 08:18:20 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:18:21 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-d08a2f81-5fa6-4352-9d4f-76f5ade1cd58 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-125727961", "imageRef": "b515545f-3b22-4d80-a102-6a318ab9717a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "8bf59083-7545-420b-b6b0-4ae8510b94a2"}], "security_groups": [{"name": "tempest-securitygroup--1837073404"}], "key_name": "tempest-keypair-1224695615", "user_data": "}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:18:21 user devstack@n-api.service[61209]: DEBUG nova.network.neutron [None req-d08a2f81-5fa6-4352-9d4f-76f5ade1cd58 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] validate_networks() for [('8bf59083-7545-420b-b6b0-4ae8510b94a2', None, None, None, None, None)] {{(pid=61209) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 08:18:22 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-d08a2f81-5fa6-4352-9d4f-76f5ade1cd58 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Flavor limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 08:18:22 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-d08a2f81-5fa6-4352-9d4f-76f5ade1cd58 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Image limits 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 08:18:22 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-d08a2f81-5fa6-4352-9d4f-76f5ade1cd58 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Flavor pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 08:18:22 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-d08a2f81-5fa6-4352-9d4f-76f5ade1cd58 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Image pref 0:0:0 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 08:18:22 user devstack@n-api.service[61209]: DEBUG nova.virt.hardware [None req-d08a2f81-5fa6-4352-9d4f-76f5ade1cd58 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61209) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 08:18:22 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d08a2f81-5fa6-4352-9d4f-76f5ade1cd58 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:18:22 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d08a2f81-5fa6-4352-9d4f-76f5ade1cd58 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:18:22 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d08a2f81-5fa6-4352-9d4f-76f5ade1cd58 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:18:22 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d08a2f81-5fa6-4352-9d4f-76f5ade1cd58 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:18:22 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d08a2f81-5fa6-4352-9d4f-76f5ade1cd58 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:18:22 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-d08a2f81-5fa6-4352-9d4f-76f5ade1cd58 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:18:22 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-d08a2f81-5fa6-4352-9d4f-76f5ade1cd58 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Getting quotas for project 13ff61fa1ead49a2b7003cbb642203ed. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:18:22 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-d08a2f81-5fa6-4352-9d4f-76f5ade1cd58 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Getting quotas for user b0515d38f20b49b3abdbc940ca7ef30b and project 13ff61fa1ead49a2b7003cbb642203ed. Resources: {'ram', 'cores', 'instances'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:18:22 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-d08a2f81-5fa6-4352-9d4f-76f5ade1cd58 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Going to run 1 instances... {{(pid=61209) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 08:18:22 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-d08a2f81-5fa6-4352-9d4f-76f5ade1cd58 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: edce7876-d1a3-417f-8384-dd03e3c412cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b515545f-3b22-4d80-a102-6a318ab9717a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61209) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 08:18:22 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-d08a2f81-5fa6-4352-9d4f-76f5ade1cd58 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.597101 Apr 19 08:18:22 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 140/427] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 08:18:21 2023] POST /compute/v2.1/servers => generated 400 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 19 08:18:22 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-d93f1f48-188f-4d22-9612-d2f34f84859a tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:18:22 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-d93f1f48-188f-4d22-9612-d2f34f84859a tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: edce7876-d1a3-417f-8384-dd03e3c412cf] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:18:22 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-d93f1f48-188f-4d22-9612-d2f34f84859a tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0515d38f20b49b3abdbc940ca7ef30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ff61fa1ead49a2b7003cbb642203ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:18:22 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-d93f1f48-188f-4d22-9612-d2f34f84859a tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edce7876-d1a3-417f-8384-dd03e3c412cf" status: 200 len: 1235 microversion: 2.1 time: 0.076065 Apr 19 08:18:22 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 145/428] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:18:22 2023] GET /compute/v2.1/servers/edce7876-d1a3-417f-8384-dd03e3c412cf => generated 1235 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:18:24 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-4c48eb23-ba06-4d54-93e2-e98f587ec812 req-d2784196-dd40-495b-ad25-dcb4ebd99db6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edce7876-d1a3-417f-8384-dd03e3c412cf", "tag": "2b06e6e6-c3a0-4452-945e-e252e480a869"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:18:24 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-4c48eb23-ba06-4d54-93e2-e98f587ec812 req-d2784196-dd40-495b-ad25-dcb4ebd99db6 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:18:24 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-4c48eb23-ba06-4d54-93e2-e98f587ec812 req-d2784196-dd40-495b-ad25-dcb4ebd99db6 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:18:24 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-4c48eb23-ba06-4d54-93e2-e98f587ec812 req-d2784196-dd40-495b-ad25-dcb4ebd99db6 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:18:24 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-4c48eb23-ba06-4d54-93e2-e98f587ec812 req-d2784196-dd40-495b-ad25-dcb4ebd99db6 service nova] Creating event network-changed:2b06e6e6-c3a0-4452-945e-e252e480a869 for instance edce7876-d1a3-417f-8384-dd03e3c412cf on user Apr 19 08:18:24 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-4c48eb23-ba06-4d54-93e2-e98f587ec812 req-d2784196-dd40-495b-ad25-dcb4ebd99db6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029386 Apr 19 08:18:24 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 144/429] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:18:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:18:26 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-e223f502-4061-4a63-b92a-4499c85e5c25 req-f3debf55-2629-4012-a198-675215db8b7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edce7876-d1a3-417f-8384-dd03e3c412cf", "name": "network-vif-plugged", "status": "completed", "tag": "2b06e6e6-c3a0-4452-945e-e252e480a869"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:18:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-e223f502-4061-4a63-b92a-4499c85e5c25 req-f3debf55-2629-4012-a198-675215db8b7e service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:18:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-e223f502-4061-4a63-b92a-4499c85e5c25 req-f3debf55-2629-4012-a198-675215db8b7e service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:18:27 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-e223f502-4061-4a63-b92a-4499c85e5c25 req-f3debf55-2629-4012-a198-675215db8b7e service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:18:27 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-e223f502-4061-4a63-b92a-4499c85e5c25 req-f3debf55-2629-4012-a198-675215db8b7e service nova] Creating event network-vif-plugged:2b06e6e6-c3a0-4452-945e-e252e480a869 for instance edce7876-d1a3-417f-8384-dd03e3c412cf on user Apr 19 08:18:27 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-e223f502-4061-4a63-b92a-4499c85e5c25 req-f3debf55-2629-4012-a198-675215db8b7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037479 Apr 19 08:18:27 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 141/430] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:18:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:18:29 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-537b9f7c-d88b-475c-b2f7-a6c337e36a08 req-574fe736-1ab7-401f-af67-936e813639fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edce7876-d1a3-417f-8384-dd03e3c412cf", "name": "network-vif-plugged", "status": "completed", "tag": "2b06e6e6-c3a0-4452-945e-e252e480a869"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:18:29 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-537b9f7c-d88b-475c-b2f7-a6c337e36a08 req-574fe736-1ab7-401f-af67-936e813639fe service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:18:29 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-537b9f7c-d88b-475c-b2f7-a6c337e36a08 req-574fe736-1ab7-401f-af67-936e813639fe service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:18:29 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-537b9f7c-d88b-475c-b2f7-a6c337e36a08 req-574fe736-1ab7-401f-af67-936e813639fe service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:18:29 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-537b9f7c-d88b-475c-b2f7-a6c337e36a08 req-574fe736-1ab7-401f-af67-936e813639fe service nova] Creating event network-vif-plugged:2b06e6e6-c3a0-4452-945e-e252e480a869 for instance edce7876-d1a3-417f-8384-dd03e3c412cf on user Apr 19 08:18:29 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-537b9f7c-d88b-475c-b2f7-a6c337e36a08 req-574fe736-1ab7-401f-af67-936e813639fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031843 Apr 19 08:18:29 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 146/431] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:18:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:19:12 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-55bb9de8-ea4f-433b-b7e0-76e26ccb00ed tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:19:12 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-55bb9de8-ea4f-433b-b7e0-76e26ccb00ed tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: edce7876-d1a3-417f-8384-dd03e3c412cf] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:19:12 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=4 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:19:12 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:19:12 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:19:12 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-55bb9de8-ea4f-433b-b7e0-76e26ccb00ed tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:19:12 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-55bb9de8-ea4f-433b-b7e0-76e26ccb00ed tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:19:12 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-55bb9de8-ea4f-433b-b7e0-76e26ccb00ed tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:19:12 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-55bb9de8-ea4f-433b-b7e0-76e26ccb00ed tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:19:12 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-55bb9de8-ea4f-433b-b7e0-76e26ccb00ed tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:19:12 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-55bb9de8-ea4f-433b-b7e0-76e26ccb00ed tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:19:12 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-55bb9de8-ea4f-433b-b7e0-76e26ccb00ed tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0515d38f20b49b3abdbc940ca7ef30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ff61fa1ead49a2b7003cbb642203ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:19:12 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-55bb9de8-ea4f-433b-b7e0-76e26ccb00ed tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edce7876-d1a3-417f-8384-dd03e3c412cf" status: 200 len: 1544 microversion: 2.1 time: 0.253114 Apr 19 08:19:12 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 145/432] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:19:12 2023] GET /compute/v2.1/servers/edce7876-d1a3-417f-8384-dd03e3c412cf => generated 1544 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:20:12 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:20:12 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=6 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:20:12 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:20:12 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=6 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:20:12 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-67e4f48c-4cad-4f3c-bb3c-6ddf405a8039 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:20:12 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-67e4f48c-4cad-4f3c-bb3c-6ddf405a8039 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: edce7876-d1a3-417f-8384-dd03e3c412cf] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:20:12 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-67e4f48c-4cad-4f3c-bb3c-6ddf405a8039 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:20:12 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-67e4f48c-4cad-4f3c-bb3c-6ddf405a8039 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:20:12 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-67e4f48c-4cad-4f3c-bb3c-6ddf405a8039 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:20:12 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-67e4f48c-4cad-4f3c-bb3c-6ddf405a8039 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:20:12 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-67e4f48c-4cad-4f3c-bb3c-6ddf405a8039 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:20:12 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-67e4f48c-4cad-4f3c-bb3c-6ddf405a8039 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:20:12 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-67e4f48c-4cad-4f3c-bb3c-6ddf405a8039 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edce7876-d1a3-417f-8384-dd03e3c412cf/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.194506 Apr 19 08:20:12 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 142/433] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 08:20:12 2023] GET /compute/v2.1/servers/edce7876-d1a3-417f-8384-dd03e3c412cf/os-interface => generated 282 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:20:13 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell0:SELECT=2 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:20:13 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:20:13 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=2 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:20:13 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-25c83271-b50f-4f8e-9491-b7deab1b11a0 req-7a7b43ee-370a-4da1-ba9e-f586db20de34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edce7876-d1a3-417f-8384-dd03e3c412cf", "tag": "2b06e6e6-c3a0-4452-945e-e252e480a869"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:20:13 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-25c83271-b50f-4f8e-9491-b7deab1b11a0 req-7a7b43ee-370a-4da1-ba9e-f586db20de34 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:20:13 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-25c83271-b50f-4f8e-9491-b7deab1b11a0 req-7a7b43ee-370a-4da1-ba9e-f586db20de34 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:20:13 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-25c83271-b50f-4f8e-9491-b7deab1b11a0 req-7a7b43ee-370a-4da1-ba9e-f586db20de34 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:20:13 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:20:13 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=6 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:20:13 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-6fdfbc7d-1457-489f-a467-635dd8503e57 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:20:13 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-25c83271-b50f-4f8e-9491-b7deab1b11a0 req-7a7b43ee-370a-4da1-ba9e-f586db20de34 service nova] Creating event network-changed:2b06e6e6-c3a0-4452-945e-e252e480a869 for instance edce7876-d1a3-417f-8384-dd03e3c412cf on user Apr 19 08:20:13 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-6fdfbc7d-1457-489f-a467-635dd8503e57 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: edce7876-d1a3-417f-8384-dd03e3c412cf] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:20:13 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-25c83271-b50f-4f8e-9491-b7deab1b11a0 req-7a7b43ee-370a-4da1-ba9e-f586db20de34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042897 Apr 19 08:20:13 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 147/434] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:20:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 19 08:20:13 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-6fdfbc7d-1457-489f-a467-635dd8503e57 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:20:13 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-6fdfbc7d-1457-489f-a467-635dd8503e57 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:20:13 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-6fdfbc7d-1457-489f-a467-635dd8503e57 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:20:13 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-6fdfbc7d-1457-489f-a467-635dd8503e57 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:20:13 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-6fdfbc7d-1457-489f-a467-635dd8503e57 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:20:13 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-6fdfbc7d-1457-489f-a467-635dd8503e57 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:20:13 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-6fdfbc7d-1457-489f-a467-635dd8503e57 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edce7876-d1a3-417f-8384-dd03e3c412cf/ips" status: 200 len: 107 microversion: 2.1 time: 0.042132 Apr 19 08:20:13 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 146/435] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 08:20:13 2023] GET /compute/v2.1/servers/edce7876-d1a3-417f-8384-dd03e3c412cf/ips => generated 107 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:20:15 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-cd5f54a6-cdb4-4cd4-a905-4ebd99694a9e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:20:15 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-cd5f54a6-cdb4-4cd4-a905-4ebd99694a9e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: edce7876-d1a3-417f-8384-dd03e3c412cf] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:20:15 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-cd5f54a6-cdb4-4cd4-a905-4ebd99694a9e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:20:15 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-cd5f54a6-cdb4-4cd4-a905-4ebd99694a9e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:20:15 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-cd5f54a6-cdb4-4cd4-a905-4ebd99694a9e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:20:15 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-cd5f54a6-cdb4-4cd4-a905-4ebd99694a9e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:20:15 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-cd5f54a6-cdb4-4cd4-a905-4ebd99694a9e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:20:15 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-cd5f54a6-cdb4-4cd4-a905-4ebd99694a9e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:20:15 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-cd5f54a6-cdb4-4cd4-a905-4ebd99694a9e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: edce7876-d1a3-417f-8384-dd03e3c412cf] Going to try to terminate instance {{(pid=61209) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:20:15 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-cd5f54a6-cdb4-4cd4-a905-4ebd99694a9e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/edce7876-d1a3-417f-8384-dd03e3c412cf" status: 204 len: 0 microversion: 2.1 time: 0.128249 Apr 19 08:20:15 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 143/436] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:20:15 2023] DELETE /compute/v2.1/servers/edce7876-d1a3-417f-8384-dd03e3c412cf => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 08:20:15 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-5e0acf5c-1b86-46c1-836f-a5d7b8b27832 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:20:15 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-5e0acf5c-1b86-46c1-836f-a5d7b8b27832 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: edce7876-d1a3-417f-8384-dd03e3c412cf] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:20:15 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-5e0acf5c-1b86-46c1-836f-a5d7b8b27832 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:20:15 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-5e0acf5c-1b86-46c1-836f-a5d7b8b27832 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:20:15 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-5e0acf5c-1b86-46c1-836f-a5d7b8b27832 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:20:15 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-5e0acf5c-1b86-46c1-836f-a5d7b8b27832 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:20:15 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-5e0acf5c-1b86-46c1-836f-a5d7b8b27832 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:20:15 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-5e0acf5c-1b86-46c1-836f-a5d7b8b27832 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:20:15 user devstack@n-api.service[61210]: DEBUG nova.policy [None req-5e0acf5c-1b86-46c1-836f-a5d7b8b27832 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0515d38f20b49b3abdbc940ca7ef30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ff61fa1ead49a2b7003cbb642203ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61210) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:20:15 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-5e0acf5c-1b86-46c1-836f-a5d7b8b27832 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edce7876-d1a3-417f-8384-dd03e3c412cf" status: 200 len: 1669 microversion: 2.1 time: 0.234211 Apr 19 08:20:15 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 148/437] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:20:15 2023] GET /compute/v2.1/servers/edce7876-d1a3-417f-8384-dd03e3c412cf => generated 1669 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:20:15 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-e783b1a8-82a7-4ee0-ad12-c27e2be7eb16 req-0c261a21-f0ba-4081-b2fd-a6b06eaf512a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edce7876-d1a3-417f-8384-dd03e3c412cf", "name": "network-vif-unplugged", "status": "completed", "tag": "2b06e6e6-c3a0-4452-945e-e252e480a869"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:20:15 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-e783b1a8-82a7-4ee0-ad12-c27e2be7eb16 req-0c261a21-f0ba-4081-b2fd-a6b06eaf512a service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:20:15 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-e783b1a8-82a7-4ee0-ad12-c27e2be7eb16 req-0c261a21-f0ba-4081-b2fd-a6b06eaf512a service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:20:15 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-e783b1a8-82a7-4ee0-ad12-c27e2be7eb16 req-0c261a21-f0ba-4081-b2fd-a6b06eaf512a service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:20:15 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-e783b1a8-82a7-4ee0-ad12-c27e2be7eb16 req-0c261a21-f0ba-4081-b2fd-a6b06eaf512a service nova] Creating event network-vif-unplugged:2b06e6e6-c3a0-4452-945e-e252e480a869 for instance edce7876-d1a3-417f-8384-dd03e3c412cf on user Apr 19 08:20:15 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-e783b1a8-82a7-4ee0-ad12-c27e2be7eb16 req-0c261a21-f0ba-4081-b2fd-a6b06eaf512a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028995 Apr 19 08:20:15 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 147/438] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:20:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:20:17 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-70d5b3f3-3b86-4536-9181-57e2b5959391 req-bdcc5fe7-6d59-4fa9-8e0d-2e6f870e758d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edce7876-d1a3-417f-8384-dd03e3c412cf", "name": "network-vif-plugged", "status": "completed", "tag": "2b06e6e6-c3a0-4452-945e-e252e480a869"}, {"server_uuid": "edce7876-d1a3-417f-8384-dd03e3c412cf", "name": "network-vif-deleted", "tag": "2b06e6e6-c3a0-4452-945e-e252e480a869"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:20:18 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-70d5b3f3-3b86-4536-9181-57e2b5959391 req-bdcc5fe7-6d59-4fa9-8e0d-2e6f870e758d service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:20:18 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-70d5b3f3-3b86-4536-9181-57e2b5959391 req-bdcc5fe7-6d59-4fa9-8e0d-2e6f870e758d service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:20:18 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-70d5b3f3-3b86-4536-9181-57e2b5959391 req-bdcc5fe7-6d59-4fa9-8e0d-2e6f870e758d service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:20:18 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-70d5b3f3-3b86-4536-9181-57e2b5959391 req-bdcc5fe7-6d59-4fa9-8e0d-2e6f870e758d service nova] Creating event network-vif-plugged:2b06e6e6-c3a0-4452-945e-e252e480a869 for instance edce7876-d1a3-417f-8384-dd03e3c412cf on user Apr 19 08:20:18 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-70d5b3f3-3b86-4536-9181-57e2b5959391 req-bdcc5fe7-6d59-4fa9-8e0d-2e6f870e758d service nova] Creating event network-vif-deleted:2b06e6e6-c3a0-4452-945e-e252e480a869 for instance edce7876-d1a3-417f-8384-dd03e3c412cf on user Apr 19 08:20:18 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-70d5b3f3-3b86-4536-9181-57e2b5959391 req-bdcc5fe7-6d59-4fa9-8e0d-2e6f870e758d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049614 Apr 19 08:20:18 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 144/439] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:20:17 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:21:05 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=4 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:21:05 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=8 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:21:05 user devstack@n-api.service[61210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 19 08:21:05 user devstack@n-api.service[61210]: Wed Apr 19 08:21:05 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/edce7876-d1a3-417f-8384-dd03e3c412cf (ip 10.0.0.210) !!! Apr 19 08:21:05 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-1c80ac18-5212-4d2b-8ff2-e8f68de3e152 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:21:05 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-1c80ac18-5212-4d2b-8ff2-e8f68de3e152 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: edce7876-d1a3-417f-8384-dd03e3c412cf] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:21:05 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-1c80ac18-5212-4d2b-8ff2-e8f68de3e152 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:21:05 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-1c80ac18-5212-4d2b-8ff2-e8f68de3e152 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:21:05 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-1c80ac18-5212-4d2b-8ff2-e8f68de3e152 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:21:05 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-1c80ac18-5212-4d2b-8ff2-e8f68de3e152 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:21:05 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-1c80ac18-5212-4d2b-8ff2-e8f68de3e152 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:21:05 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-1c80ac18-5212-4d2b-8ff2-e8f68de3e152 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:21:05 user devstack@n-api.service[61210]: INFO nova.api.openstack.wsgi [None req-1c80ac18-5212-4d2b-8ff2-e8f68de3e152 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] HTTP exception thrown: Instance edce7876-d1a3-417f-8384-dd03e3c412cf could not be found. Apr 19 08:21:05 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-1c80ac18-5212-4d2b-8ff2-e8f68de3e152 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Request method failure captured: Apr 19 08:21:05 user devstack@n-api.service[61210]: request: GET /compute/v2.1/servers/edce7876-d1a3-417f-8384-dd03e3c412cf HTTP/1.1 Apr 19 08:21:05 user devstack@n-api.service[61210]: Accept: application/json Apr 19 08:21:05 user devstack@n-api.service[61210]: Accept-Encoding: identity Apr 19 08:21:05 user devstack@n-api.service[61210]: Connection: close Apr 19 08:21:05 user devstack@n-api.service[61210]: Content-Length: 0 Apr 19 08:21:05 user devstack@n-api.service[61210]: Content-Type: application/json Apr 19 08:21:05 user devstack@n-api.service[61210]: Host: 10.0.0.210 Apr 19 08:21:05 user devstack@n-api.service[61210]: Openstack-System-Scope: None Apr 19 08:21:05 user devstack@n-api.service[61210]: User-Agent: python-urllib3/1.26.15 Apr 19 08:21:05 user devstack@n-api.service[61210]: X-Auth-Token: gAAAAABkP6Ml6AVFrdZmwG6v9Ak3nCCxOWNoGRyfAY9VXfGPn2QRTKj8vAEzIe-ofIP9WqCqx0spEaxwaexIys1H26tCx3kz4GWtv8Xu-fJN6P665TCoRMxFVlmLehXlVDrwWQkUD447jYgz_ODpB5iqaKc80Q8eZ0hryuWlvyy82V75C3ahBos Apr 19 08:21:05 user devstack@n-api.service[61210]: X-Domain-Id: None Apr 19 08:21:05 user devstack@n-api.service[61210]: X-Domain-Name: None Apr 19 08:21:05 user devstack@n-api.service[61210]: X-Identity-Status: Confirmed Apr 19 08:21:05 user devstack@n-api.service[61210]: X-Is-Admin-Project: True Apr 19 08:21:05 user devstack@n-api.service[61210]: X-Project-Domain-Id: default Apr 19 08:21:05 user devstack@n-api.service[61210]: X-Project-Domain-Name: Default Apr 19 08:21:05 user devstack@n-api.service[61210]: X-Project-Id: 13ff61fa1ead49a2b7003cbb642203ed Apr 19 08:21:05 user devstack@n-api.service[61210]: X-Project-Name: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:21:05 user devstack@n-api.service[61210]: X-Role: reader,member Apr 19 08:21:05 user devstack@n-api.service[61210]: X-Roles: reader,member Apr 19 08:21:05 user devstack@n-api.service[61210]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13ff61fa1ead49a2b7003cbb642203ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13ff61fa1ead49a2b7003cbb642203ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13ff61fa1ead49a2b7003cbb642203ed"}]}] Apr 19 08:21:05 user devstack@n-api.service[61210]: X-Tenant: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:21:05 user devstack@n-api.service[61210]: X-Tenant-Id: 13ff61fa1ead49a2b7003cbb642203ed Apr 19 08:21:05 user devstack@n-api.service[61210]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:21:05 user devstack@n-api.service[61210]: X-User: tempest-AttachVolumeNegativeTest-172980430-project-member Apr 19 08:21:05 user devstack@n-api.service[61210]: X-User-Domain-Id: default Apr 19 08:21:05 user devstack@n-api.service[61210]: X-User-Domain-Name: Default Apr 19 08:21:05 user devstack@n-api.service[61210]: X-User-Id: b0515d38f20b49b3abdbc940ca7ef30b Apr 19 08:21:05 user devstack@n-api.service[61210]: X-User-Name: tempest-AttachVolumeNegativeTest-172980430-project-member Apr 19 08:21:05 user devstack@n-api.service[61210]: method: > Apr 19 08:21:05 user devstack@n-api.service[61210]: exception: Instance edce7876-d1a3-417f-8384-dd03e3c412cf could not be found. Apr 19 08:21:05 user devstack@n-api.service[61210]: action_args: {'id': 'edce7876-d1a3-417f-8384-dd03e3c412cf'} Apr 19 08:21:05 user devstack@n-api.service[61210]: {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edce7876-d1a3-417f-8384-dd03e3c412cf could not be found. Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edce7876-d1a3-417f-8384-dd03e3c412cf could not be found. Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edce7876-d1a3-417f-8384-dd03e3c412cf could not be found. Apr 19 08:21:05 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:21:05 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-1c80ac18-5212-4d2b-8ff2-e8f68de3e152 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Returning 404 to user: Instance edce7876-d1a3-417f-8384-dd03e3c412cf could not be found. {{(pid=61210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:21:05 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-1c80ac18-5212-4d2b-8ff2-e8f68de3e152 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edce7876-d1a3-417f-8384-dd03e3c412cf" status: 404 len: 111 microversion: 2.1 time: 0.214586 Apr 19 08:21:05 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 149/440] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:21:05 2023] GET /compute/v2.1/servers/edce7876-d1a3-417f-8384-dd03e3c412cf => generated 111 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:21:05 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=4 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:21:05 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=6 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:21:05 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-0128b830-71b2-4cfb-8a65-0296b939b7a0 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '.version_select at 0x7f2c00e588b0>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:21:05 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-0128b830-71b2-4cfb-8a65-0296b939b7a0 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1224695615" status: 202 len: 0 microversion: 2.1 time: 0.028585 Apr 19 08:21:05 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 148/441] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 08:21:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1224695615 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 08:21:06 user devstack@n-api.service[61209]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 19 08:21:06 user devstack@n-api.service[61209]: Wed Apr 19 08:21:06 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Apr 19 08:21:06 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:21:06 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:21:06 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-52558ff6-6678-4229-827e-21e7e94c836e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Action: 'create', calling method: .version_select at 0x7f2c010cd6c0>, body: {"keypair": {"name": "tempest-keypair-1557599549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEu1uPE/QfL7CBAi/qiOQXfGNfnYUSEzNIAC71ZNzNd0asvFTJwzdWneIwnIDot3/dOWj2PQUdDgCaNLm/zHZ4BKGyJCh/nqLiEYoST06V8f5uYiMn/H4zWCwMWM/k+ExA=="}} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:21:06 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-52558ff6-6678-4229-827e-21e7e94c836e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Getting quotas for project 13ff61fa1ead49a2b7003cbb642203ed. Resources: {'key_pairs'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:21:06 user devstack@n-api.service[61209]: DEBUG nova.quota [None req-52558ff6-6678-4229-827e-21e7e94c836e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Getting quotas for user b0515d38f20b49b3abdbc940ca7ef30b and project 13ff61fa1ead49a2b7003cbb642203ed. Resources: {'key_pairs'} {{(pid=61209) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:21:06 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-52558ff6-6678-4229-827e-21e7e94c836e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.092517 Apr 19 08:21:06 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 145/442] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 19 08:21:06 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:21:08 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-b3951f35-052d-45a7-9521-e2de8f957e5c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1252155495", "imageRef": "b515545f-3b22-4d80-a102-6a318ab9717a", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "8bf59083-7545-420b-b6b0-4ae8510b94a2"}], "security_groups": [{"name": "tempest-securitygroup--1288972870"}], "key_name": "tempest-keypair-1557599549", "user_data": "}} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:21:08 user devstack@n-api.service[61210]: DEBUG nova.network.neutron [None req-b3951f35-052d-45a7-9521-e2de8f957e5c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] validate_networks() for [('8bf59083-7545-420b-b6b0-4ae8510b94a2', None, None, None, None, None)] {{(pid=61210) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 19 08:21:08 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-b3951f35-052d-45a7-9521-e2de8f957e5c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Flavor limits 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 19 08:21:08 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-b3951f35-052d-45a7-9521-e2de8f957e5c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Image limits 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 19 08:21:08 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-b3951f35-052d-45a7-9521-e2de8f957e5c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Flavor pref 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 19 08:21:08 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-b3951f35-052d-45a7-9521-e2de8f957e5c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Image pref 0:0:0 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 19 08:21:08 user devstack@n-api.service[61210]: DEBUG nova.virt.hardware [None req-b3951f35-052d-45a7-9521-e2de8f957e5c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 19 08:21:08 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-b3951f35-052d-45a7-9521-e2de8f957e5c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:21:08 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-b3951f35-052d-45a7-9521-e2de8f957e5c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:21:08 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-b3951f35-052d-45a7-9521-e2de8f957e5c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:21:08 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-b3951f35-052d-45a7-9521-e2de8f957e5c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:21:08 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-b3951f35-052d-45a7-9521-e2de8f957e5c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:21:08 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-b3951f35-052d-45a7-9521-e2de8f957e5c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:21:08 user devstack@n-api.service[61210]: DEBUG nova.quota [None req-b3951f35-052d-45a7-9521-e2de8f957e5c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Getting quotas for project 13ff61fa1ead49a2b7003cbb642203ed. Resources: {'ram', 'cores', 'instances'} {{(pid=61210) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 19 08:21:08 user devstack@n-api.service[61210]: DEBUG nova.quota [None req-b3951f35-052d-45a7-9521-e2de8f957e5c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Getting quotas for user b0515d38f20b49b3abdbc940ca7ef30b and project 13ff61fa1ead49a2b7003cbb642203ed. Resources: {'ram', 'cores', 'instances'} {{(pid=61210) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 19 08:21:08 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-b3951f35-052d-45a7-9521-e2de8f957e5c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Going to run 1 instances... {{(pid=61210) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 19 08:21:08 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-b3951f35-052d-45a7-9521-e2de8f957e5c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: 78f0ddf0-4199-4bc6-89c5-20a20083f442] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b515545f-3b22-4d80-a102-6a318ab9717a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61210) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 19 08:21:08 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-b3951f35-052d-45a7-9521-e2de8f957e5c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.771884 Apr 19 08:21:08 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 150/443] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 19 08:21:08 2023] POST /compute/v2.1/servers => generated 400 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 19 08:21:08 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-45d4aa33-ba89-4680-acf6-290812c17b78 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:21:08 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-45d4aa33-ba89-4680-acf6-290812c17b78 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: 78f0ddf0-4199-4bc6-89c5-20a20083f442] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:21:08 user devstack@n-api.service[61208]: DEBUG nova.policy [None req-45d4aa33-ba89-4680-acf6-290812c17b78 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0515d38f20b49b3abdbc940ca7ef30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ff61fa1ead49a2b7003cbb642203ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61208) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:21:08 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-45d4aa33-ba89-4680-acf6-290812c17b78 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78f0ddf0-4199-4bc6-89c5-20a20083f442" status: 200 len: 1236 microversion: 2.1 time: 0.146882 Apr 19 08:21:08 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 149/444] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:21:08 2023] GET /compute/v2.1/servers/78f0ddf0-4199-4bc6-89c5-20a20083f442 => generated 1236 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 19 08:21:11 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-08e74064-9982-4c3f-bd03-955f18428b59 req-0a40a739-4edb-4cf1-873e-6f4de666eed1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78f0ddf0-4199-4bc6-89c5-20a20083f442", "tag": "2fb61846-6d65-491f-aa38-da2de86500d0"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:21:11 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-08e74064-9982-4c3f-bd03-955f18428b59 req-0a40a739-4edb-4cf1-873e-6f4de666eed1 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:21:11 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-08e74064-9982-4c3f-bd03-955f18428b59 req-0a40a739-4edb-4cf1-873e-6f4de666eed1 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:21:11 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-08e74064-9982-4c3f-bd03-955f18428b59 req-0a40a739-4edb-4cf1-873e-6f4de666eed1 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:21:11 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-08e74064-9982-4c3f-bd03-955f18428b59 req-0a40a739-4edb-4cf1-873e-6f4de666eed1 service nova] Creating event network-changed:2fb61846-6d65-491f-aa38-da2de86500d0 for instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 on user Apr 19 08:21:11 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-08e74064-9982-4c3f-bd03-955f18428b59 req-0a40a739-4edb-4cf1-873e-6f4de666eed1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099632 Apr 19 08:21:11 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 146/445] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:21:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:21:13 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-b53251bb-6bae-484f-9eb6-7a45ed11d7a9 req-b2b77ca2-1197-4b7f-93c0-ceaf626d1851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78f0ddf0-4199-4bc6-89c5-20a20083f442", "name": "network-vif-plugged", "status": "completed", "tag": "2fb61846-6d65-491f-aa38-da2de86500d0"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:21:13 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-b53251bb-6bae-484f-9eb6-7a45ed11d7a9 req-b2b77ca2-1197-4b7f-93c0-ceaf626d1851 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:21:13 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-b53251bb-6bae-484f-9eb6-7a45ed11d7a9 req-b2b77ca2-1197-4b7f-93c0-ceaf626d1851 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:21:13 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-b53251bb-6bae-484f-9eb6-7a45ed11d7a9 req-b2b77ca2-1197-4b7f-93c0-ceaf626d1851 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:21:13 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-b53251bb-6bae-484f-9eb6-7a45ed11d7a9 req-b2b77ca2-1197-4b7f-93c0-ceaf626d1851 service nova] Creating event network-vif-plugged:2fb61846-6d65-491f-aa38-da2de86500d0 for instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 on user Apr 19 08:21:13 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-b53251bb-6bae-484f-9eb6-7a45ed11d7a9 req-b2b77ca2-1197-4b7f-93c0-ceaf626d1851 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103587 Apr 19 08:21:13 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 151/446] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:21:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:21:15 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-2c863ca7-9a01-4ddf-a0a7-ec27928b6280 req-8bce207f-c71f-4d23-b4c1-96a64416985b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78f0ddf0-4199-4bc6-89c5-20a20083f442", "name": "network-vif-plugged", "status": "completed", "tag": "2fb61846-6d65-491f-aa38-da2de86500d0"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:21:15 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-2c863ca7-9a01-4ddf-a0a7-ec27928b6280 req-8bce207f-c71f-4d23-b4c1-96a64416985b service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:21:15 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-2c863ca7-9a01-4ddf-a0a7-ec27928b6280 req-8bce207f-c71f-4d23-b4c1-96a64416985b service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:21:15 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-2c863ca7-9a01-4ddf-a0a7-ec27928b6280 req-8bce207f-c71f-4d23-b4c1-96a64416985b service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:21:15 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-2c863ca7-9a01-4ddf-a0a7-ec27928b6280 req-8bce207f-c71f-4d23-b4c1-96a64416985b service nova] Creating event network-vif-plugged:2fb61846-6d65-491f-aa38-da2de86500d0 for instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 on user Apr 19 08:21:15 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-2c863ca7-9a01-4ddf-a0a7-ec27928b6280 req-8bce207f-c71f-4d23-b4c1-96a64416985b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029590 Apr 19 08:21:15 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 150/447] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:21:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:21:59 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell0:SELECT=4 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:21:59 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:21:59 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:21:59 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-8fcfe3ee-f0d8-48d3-bfe4-5ac17f45a23d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:21:59 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-8fcfe3ee-f0d8-48d3-bfe4-5ac17f45a23d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: 78f0ddf0-4199-4bc6-89c5-20a20083f442] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:21:59 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-8fcfe3ee-f0d8-48d3-bfe4-5ac17f45a23d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:21:59 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-8fcfe3ee-f0d8-48d3-bfe4-5ac17f45a23d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:21:59 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-8fcfe3ee-f0d8-48d3-bfe4-5ac17f45a23d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:21:59 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-8fcfe3ee-f0d8-48d3-bfe4-5ac17f45a23d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:21:59 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-8fcfe3ee-f0d8-48d3-bfe4-5ac17f45a23d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:21:59 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-8fcfe3ee-f0d8-48d3-bfe4-5ac17f45a23d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:21:59 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-8fcfe3ee-f0d8-48d3-bfe4-5ac17f45a23d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0515d38f20b49b3abdbc940ca7ef30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ff61fa1ead49a2b7003cbb642203ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:21:59 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-8fcfe3ee-f0d8-48d3-bfe4-5ac17f45a23d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78f0ddf0-4199-4bc6-89c5-20a20083f442" status: 200 len: 1545 microversion: 2.1 time: 0.308138 Apr 19 08:21:59 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 147/448] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:21:59 2023] GET /compute/v2.1/servers/78f0ddf0-4199-4bc6-89c5-20a20083f442 => generated 1545 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:22:59 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell0:SELECT=2 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:22:59 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell0:SELECT=6 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:22:59 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:22:59 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=6 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:22:59 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-5f7cca3e-21ac-4420-aafc-89860c1a9076 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:22:59 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-5f7cca3e-21ac-4420-aafc-89860c1a9076 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: 78f0ddf0-4199-4bc6-89c5-20a20083f442] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:22:59 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-5f7cca3e-21ac-4420-aafc-89860c1a9076 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:22:59 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-5f7cca3e-21ac-4420-aafc-89860c1a9076 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:22:59 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-5f7cca3e-21ac-4420-aafc-89860c1a9076 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:22:59 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-5f7cca3e-21ac-4420-aafc-89860c1a9076 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:22:59 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-5f7cca3e-21ac-4420-aafc-89860c1a9076 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:22:59 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-5f7cca3e-21ac-4420-aafc-89860c1a9076 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:22:59 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-5f7cca3e-21ac-4420-aafc-89860c1a9076 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78f0ddf0-4199-4bc6-89c5-20a20083f442/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.276891 Apr 19 08:22:59 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 152/449] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 19 08:22:59 2023] GET /compute/v2.1/servers/78f0ddf0-4199-4bc6-89c5-20a20083f442/os-interface => generated 282 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:23:00 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell0:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:23:00 user devstack@n-api.service[61208]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 19 08:23:00 user devstack@n-api.service[61208]: Wed Apr 19 08:23:00 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 19 08:23:00 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:23:00 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=2 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:23:00 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=2 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:23:00 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=6 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:23:00 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-006e5e49-6cb4-4a15-bcd5-d98457ea4e03 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:23:00 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-006e5e49-6cb4-4a15-bcd5-d98457ea4e03 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: 78f0ddf0-4199-4bc6-89c5-20a20083f442] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:23:00 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-006e5e49-6cb4-4a15-bcd5-d98457ea4e03 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:00 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-006e5e49-6cb4-4a15-bcd5-d98457ea4e03 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:00 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-006e5e49-6cb4-4a15-bcd5-d98457ea4e03 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:00 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-006e5e49-6cb4-4a15-bcd5-d98457ea4e03 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:00 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-006e5e49-6cb4-4a15-bcd5-d98457ea4e03 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:00 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-006e5e49-6cb4-4a15-bcd5-d98457ea4e03 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:00 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-bbbf29bd-6ea1-4107-8c46-236327df23cd req-38d49ff8-3429-443b-b572-4a2c225411ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78f0ddf0-4199-4bc6-89c5-20a20083f442", "tag": "2fb61846-6d65-491f-aa38-da2de86500d0"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:23:00 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-bbbf29bd-6ea1-4107-8c46-236327df23cd req-38d49ff8-3429-443b-b572-4a2c225411ce service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:00 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-bbbf29bd-6ea1-4107-8c46-236327df23cd req-38d49ff8-3429-443b-b572-4a2c225411ce service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:00 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-bbbf29bd-6ea1-4107-8c46-236327df23cd req-38d49ff8-3429-443b-b572-4a2c225411ce service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:00 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-006e5e49-6cb4-4a15-bcd5-d98457ea4e03 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78f0ddf0-4199-4bc6-89c5-20a20083f442/ips" status: 200 len: 107 microversion: 2.1 time: 0.042977 Apr 19 08:23:00 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 148/450] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 19 08:23:00 2023] GET /compute/v2.1/servers/78f0ddf0-4199-4bc6-89c5-20a20083f442/ips => generated 107 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:23:00 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-bbbf29bd-6ea1-4107-8c46-236327df23cd req-38d49ff8-3429-443b-b572-4a2c225411ce service nova] Creating event network-changed:2fb61846-6d65-491f-aa38-da2de86500d0 for instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 on user Apr 19 08:23:00 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-bbbf29bd-6ea1-4107-8c46-236327df23cd req-38d49ff8-3429-443b-b572-4a2c225411ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099395 Apr 19 08:23:00 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 151/451] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:23:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:23:02 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-7d75cf06-26a8-4d76-be47-f86f4f1abd9e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:23:02 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-7d75cf06-26a8-4d76-be47-f86f4f1abd9e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: 78f0ddf0-4199-4bc6-89c5-20a20083f442] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:23:02 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-7d75cf06-26a8-4d76-be47-f86f4f1abd9e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:02 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-7d75cf06-26a8-4d76-be47-f86f4f1abd9e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:02 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-7d75cf06-26a8-4d76-be47-f86f4f1abd9e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:02 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-7d75cf06-26a8-4d76-be47-f86f4f1abd9e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:02 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-7d75cf06-26a8-4d76-be47-f86f4f1abd9e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:02 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-7d75cf06-26a8-4d76-be47-f86f4f1abd9e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:02 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-7d75cf06-26a8-4d76-be47-f86f4f1abd9e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: 78f0ddf0-4199-4bc6-89c5-20a20083f442] Going to try to terminate instance {{(pid=61210) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 19 08:23:02 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-7d75cf06-26a8-4d76-be47-f86f4f1abd9e tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/78f0ddf0-4199-4bc6-89c5-20a20083f442" status: 204 len: 0 microversion: 2.1 time: 0.121333 Apr 19 08:23:02 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 153/452] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:23:02 2023] DELETE /compute/v2.1/servers/78f0ddf0-4199-4bc6-89c5-20a20083f442 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 19 08:23:02 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-a4548757-86eb-44c3-b6dd-64191336c2cb tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:23:02 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-a4548757-86eb-44c3-b6dd-64191336c2cb tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: 78f0ddf0-4199-4bc6-89c5-20a20083f442] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:23:02 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-a4548757-86eb-44c3-b6dd-64191336c2cb tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:02 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-a4548757-86eb-44c3-b6dd-64191336c2cb tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:02 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-a4548757-86eb-44c3-b6dd-64191336c2cb tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:02 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-a4548757-86eb-44c3-b6dd-64191336c2cb tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:02 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-a4548757-86eb-44c3-b6dd-64191336c2cb tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:02 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-a4548757-86eb-44c3-b6dd-64191336c2cb tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:02 user devstack@n-api.service[61209]: DEBUG nova.policy [None req-a4548757-86eb-44c3-b6dd-64191336c2cb tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0515d38f20b49b3abdbc940ca7ef30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ff61fa1ead49a2b7003cbb642203ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61209) authorize /opt/stack/nova/nova/policy.py:203}} Apr 19 08:23:02 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-a4548757-86eb-44c3-b6dd-64191336c2cb tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78f0ddf0-4199-4bc6-89c5-20a20083f442" status: 200 len: 1670 microversion: 2.1 time: 0.343064 Apr 19 08:23:02 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 149/453] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:23:02 2023] GET /compute/v2.1/servers/78f0ddf0-4199-4bc6-89c5-20a20083f442 => generated 1670 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 19 08:23:02 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [req-f97bf9d3-55b6-4a9b-ab61-f679e54b6530 req-0f963d21-1195-460b-ac48-591354a91d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78f0ddf0-4199-4bc6-89c5-20a20083f442", "name": "network-vif-unplugged", "status": "completed", "tag": "2fb61846-6d65-491f-aa38-da2de86500d0"}]} {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:23:02 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-f97bf9d3-55b6-4a9b-ab61-f679e54b6530 req-0f963d21-1195-460b-ac48-591354a91d30 service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:02 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-f97bf9d3-55b6-4a9b-ab61-f679e54b6530 req-0f963d21-1195-460b-ac48-591354a91d30 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:02 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [req-f97bf9d3-55b6-4a9b-ab61-f679e54b6530 req-0f963d21-1195-460b-ac48-591354a91d30 service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:02 user devstack@n-api.service[61208]: INFO nova.api.openstack.compute.server_external_events [req-f97bf9d3-55b6-4a9b-ab61-f679e54b6530 req-0f963d21-1195-460b-ac48-591354a91d30 service nova] Creating event network-vif-unplugged:2fb61846-6d65-491f-aa38-da2de86500d0 for instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 on user Apr 19 08:23:02 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [req-f97bf9d3-55b6-4a9b-ab61-f679e54b6530 req-0f963d21-1195-460b-ac48-591354a91d30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028992 Apr 19 08:23:02 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 152/454] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:23:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:23:04 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [req-010a822e-9a6e-418a-8dfb-743a581e596c req-11b21e42-5575-4a17-8c28-810aa5ae5bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78f0ddf0-4199-4bc6-89c5-20a20083f442", "name": "network-vif-deleted", "tag": "2fb61846-6d65-491f-aa38-da2de86500d0"}]} {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:23:04 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-010a822e-9a6e-418a-8dfb-743a581e596c req-11b21e42-5575-4a17-8c28-810aa5ae5bce service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:04 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-010a822e-9a6e-418a-8dfb-743a581e596c req-11b21e42-5575-4a17-8c28-810aa5ae5bce service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:04 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [req-010a822e-9a6e-418a-8dfb-743a581e596c req-11b21e42-5575-4a17-8c28-810aa5ae5bce service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:04 user devstack@n-api.service[61210]: INFO nova.api.openstack.compute.server_external_events [req-010a822e-9a6e-418a-8dfb-743a581e596c req-11b21e42-5575-4a17-8c28-810aa5ae5bce service nova] Creating event network-vif-deleted:2fb61846-6d65-491f-aa38-da2de86500d0 for instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 on user Apr 19 08:23:04 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [req-010a822e-9a6e-418a-8dfb-743a581e596c req-11b21e42-5575-4a17-8c28-810aa5ae5bce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032365 Apr 19 08:23:04 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 154/455] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:23:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:23:04 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [req-c8f50425-2eb1-45f7-9869-06e94503c097 req-39b28579-3d4d-48cc-b959-96b088af257a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78f0ddf0-4199-4bc6-89c5-20a20083f442", "name": "network-vif-plugged", "status": "completed", "tag": "2fb61846-6d65-491f-aa38-da2de86500d0"}]} {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 19 08:23:05 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-c8f50425-2eb1-45f7-9869-06e94503c097 req-39b28579-3d4d-48cc-b959-96b088af257a service nova] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:05 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-c8f50425-2eb1-45f7-9869-06e94503c097 req-39b28579-3d4d-48cc-b959-96b088af257a service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:05 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [req-c8f50425-2eb1-45f7-9869-06e94503c097 req-39b28579-3d4d-48cc-b959-96b088af257a service nova] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:05 user devstack@n-api.service[61209]: INFO nova.api.openstack.compute.server_external_events [req-c8f50425-2eb1-45f7-9869-06e94503c097 req-39b28579-3d4d-48cc-b959-96b088af257a service nova] Creating event network-vif-plugged:2fb61846-6d65-491f-aa38-da2de86500d0 for instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 on user Apr 19 08:23:05 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [req-c8f50425-2eb1-45f7-9869-06e94503c097 req-39b28579-3d4d-48cc-b959-96b088af257a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032822 Apr 19 08:23:05 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 150/456] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 19 08:23:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 19 08:23:52 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_api:SELECT=4 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:23:52 user devstack@n-api.service[61208]: DEBUG dbcounter [-] [61208] Writing DB stats nova_cell1:SELECT=4 {{(pid=61208) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:23:52 user devstack@n-api.service[61208]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 19 08:23:52 user devstack@n-api.service[61208]: Wed Apr 19 08:23:52 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/78f0ddf0-4199-4bc6-89c5-20a20083f442 (ip 10.0.0.210) !!! Apr 19 08:23:52 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-4d494961-9cb8-4b70-8d65-7f55d68f3ccf tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:23:52 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-4d494961-9cb8-4b70-8d65-7f55d68f3ccf tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: 78f0ddf0-4199-4bc6-89c5-20a20083f442] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:23:52 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4d494961-9cb8-4b70-8d65-7f55d68f3ccf tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:52 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4d494961-9cb8-4b70-8d65-7f55d68f3ccf tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:52 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4d494961-9cb8-4b70-8d65-7f55d68f3ccf tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:52 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4d494961-9cb8-4b70-8d65-7f55d68f3ccf tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:52 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4d494961-9cb8-4b70-8d65-7f55d68f3ccf tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:52 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-4d494961-9cb8-4b70-8d65-7f55d68f3ccf tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:52 user devstack@n-api.service[61208]: INFO nova.api.openstack.wsgi [None req-4d494961-9cb8-4b70-8d65-7f55d68f3ccf tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] HTTP exception thrown: Instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 could not be found. Apr 19 08:23:52 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-4d494961-9cb8-4b70-8d65-7f55d68f3ccf tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Request method failure captured: Apr 19 08:23:52 user devstack@n-api.service[61208]: request: GET /compute/v2.1/servers/78f0ddf0-4199-4bc6-89c5-20a20083f442 HTTP/1.1 Apr 19 08:23:52 user devstack@n-api.service[61208]: Accept: application/json Apr 19 08:23:52 user devstack@n-api.service[61208]: Accept-Encoding: identity Apr 19 08:23:52 user devstack@n-api.service[61208]: Connection: close Apr 19 08:23:52 user devstack@n-api.service[61208]: Content-Length: 0 Apr 19 08:23:52 user devstack@n-api.service[61208]: Content-Type: application/json Apr 19 08:23:52 user devstack@n-api.service[61208]: Host: 10.0.0.210 Apr 19 08:23:52 user devstack@n-api.service[61208]: Openstack-System-Scope: None Apr 19 08:23:52 user devstack@n-api.service[61208]: User-Agent: python-urllib3/1.26.15 Apr 19 08:23:52 user devstack@n-api.service[61208]: X-Auth-Token: gAAAAABkP6Ml6AVFrdZmwG6v9Ak3nCCxOWNoGRyfAY9VXfGPn2QRTKj8vAEzIe-ofIP9WqCqx0spEaxwaexIys1H26tCx3kz4GWtv8Xu-fJN6P665TCoRMxFVlmLehXlVDrwWQkUD447jYgz_ODpB5iqaKc80Q8eZ0hryuWlvyy82V75C3ahBos Apr 19 08:23:52 user devstack@n-api.service[61208]: X-Domain-Id: None Apr 19 08:23:52 user devstack@n-api.service[61208]: X-Domain-Name: None Apr 19 08:23:52 user devstack@n-api.service[61208]: X-Identity-Status: Confirmed Apr 19 08:23:52 user devstack@n-api.service[61208]: X-Is-Admin-Project: True Apr 19 08:23:52 user devstack@n-api.service[61208]: X-Project-Domain-Id: default Apr 19 08:23:52 user devstack@n-api.service[61208]: X-Project-Domain-Name: Default Apr 19 08:23:52 user devstack@n-api.service[61208]: X-Project-Id: 13ff61fa1ead49a2b7003cbb642203ed Apr 19 08:23:52 user devstack@n-api.service[61208]: X-Project-Name: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:23:52 user devstack@n-api.service[61208]: X-Role: reader,member Apr 19 08:23:52 user devstack@n-api.service[61208]: X-Roles: reader,member Apr 19 08:23:52 user devstack@n-api.service[61208]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13ff61fa1ead49a2b7003cbb642203ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13ff61fa1ead49a2b7003cbb642203ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13ff61fa1ead49a2b7003cbb642203ed"}]}] Apr 19 08:23:52 user devstack@n-api.service[61208]: X-Tenant: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:23:52 user devstack@n-api.service[61208]: X-Tenant-Id: 13ff61fa1ead49a2b7003cbb642203ed Apr 19 08:23:52 user devstack@n-api.service[61208]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:23:52 user devstack@n-api.service[61208]: X-User: tempest-AttachVolumeNegativeTest-172980430-project-member Apr 19 08:23:52 user devstack@n-api.service[61208]: X-User-Domain-Id: default Apr 19 08:23:52 user devstack@n-api.service[61208]: X-User-Domain-Name: Default Apr 19 08:23:52 user devstack@n-api.service[61208]: X-User-Id: b0515d38f20b49b3abdbc940ca7ef30b Apr 19 08:23:52 user devstack@n-api.service[61208]: X-User-Name: tempest-AttachVolumeNegativeTest-172980430-project-member Apr 19 08:23:52 user devstack@n-api.service[61208]: method: > Apr 19 08:23:52 user devstack@n-api.service[61208]: exception: Instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 could not be found. Apr 19 08:23:52 user devstack@n-api.service[61208]: action_args: {'id': '78f0ddf0-4199-4bc6-89c5-20a20083f442'} Apr 19 08:23:52 user devstack@n-api.service[61208]: {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 could not be found. Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 could not be found. Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 could not be found. Apr 19 08:23:52 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:23:52 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-4d494961-9cb8-4b70-8d65-7f55d68f3ccf tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Returning 404 to user: Instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 could not be found. {{(pid=61208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:23:52 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-4d494961-9cb8-4b70-8d65-7f55d68f3ccf tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78f0ddf0-4199-4bc6-89c5-20a20083f442" status: 404 len: 111 microversion: 2.1 time: 0.039790 Apr 19 08:23:52 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 153/457] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:23:52 2023] GET /compute/v2.1/servers/78f0ddf0-4199-4bc6-89c5-20a20083f442 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:23:52 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:23:52 user devstack@n-api.service[61210]: DEBUG dbcounter [-] [61210] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61210) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:23:52 user devstack@n-api.service[61210]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 19 08:23:52 user devstack@n-api.service[61210]: Wed Apr 19 08:23:52 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1557599549 (ip 10.0.0.210) !!! Apr 19 08:23:52 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-b94d489f-5f6f-4892-afd9-cef86dfd5c5c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '.version_select at 0x7f2c00eaaef0>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:23:52 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-b94d489f-5f6f-4892-afd9-cef86dfd5c5c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557599549" status: 202 len: 0 microversion: 2.1 time: 0.058908 Apr 19 08:23:52 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 155/458] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 19 08:23:52 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557599549 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 19 08:23:53 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_api:SELECT=6 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:23:53 user devstack@n-api.service[61209]: DEBUG dbcounter [-] [61209] Writing DB stats nova_cell1:SELECT=12 {{(pid=61209) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 19 08:23:53 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-f7146aa5-fa92-4de5-8d8a-4661fb181f4b tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:23:53 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-f7146aa5-fa92-4de5-8d8a-4661fb181f4b tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: 78f0ddf0-4199-4bc6-89c5-20a20083f442] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:23:53 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-f7146aa5-fa92-4de5-8d8a-4661fb181f4b tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:53 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-f7146aa5-fa92-4de5-8d8a-4661fb181f4b tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:53 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-f7146aa5-fa92-4de5-8d8a-4661fb181f4b tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:53 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-f7146aa5-fa92-4de5-8d8a-4661fb181f4b tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:53 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-f7146aa5-fa92-4de5-8d8a-4661fb181f4b tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:53 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-f7146aa5-fa92-4de5-8d8a-4661fb181f4b tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:53 user devstack@n-api.service[61209]: INFO nova.api.openstack.wsgi [None req-f7146aa5-fa92-4de5-8d8a-4661fb181f4b tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] HTTP exception thrown: Instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 could not be found. Apr 19 08:23:53 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-f7146aa5-fa92-4de5-8d8a-4661fb181f4b tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Request method failure captured: Apr 19 08:23:53 user devstack@n-api.service[61209]: request: DELETE /compute/v2.1/servers/78f0ddf0-4199-4bc6-89c5-20a20083f442 HTTP/1.1 Apr 19 08:23:53 user devstack@n-api.service[61209]: Accept: application/json Apr 19 08:23:53 user devstack@n-api.service[61209]: Accept-Encoding: identity Apr 19 08:23:53 user devstack@n-api.service[61209]: Connection: close Apr 19 08:23:53 user devstack@n-api.service[61209]: Content-Length: 0 Apr 19 08:23:53 user devstack@n-api.service[61209]: Content-Type: application/json Apr 19 08:23:53 user devstack@n-api.service[61209]: Host: 10.0.0.210 Apr 19 08:23:53 user devstack@n-api.service[61209]: Openstack-System-Scope: None Apr 19 08:23:53 user devstack@n-api.service[61209]: User-Agent: python-urllib3/1.26.15 Apr 19 08:23:53 user devstack@n-api.service[61209]: X-Auth-Token: gAAAAABkP6Ml6AVFrdZmwG6v9Ak3nCCxOWNoGRyfAY9VXfGPn2QRTKj8vAEzIe-ofIP9WqCqx0spEaxwaexIys1H26tCx3kz4GWtv8Xu-fJN6P665TCoRMxFVlmLehXlVDrwWQkUD447jYgz_ODpB5iqaKc80Q8eZ0hryuWlvyy82V75C3ahBos Apr 19 08:23:53 user devstack@n-api.service[61209]: X-Domain-Id: None Apr 19 08:23:53 user devstack@n-api.service[61209]: X-Domain-Name: None Apr 19 08:23:53 user devstack@n-api.service[61209]: X-Identity-Status: Confirmed Apr 19 08:23:53 user devstack@n-api.service[61209]: X-Is-Admin-Project: True Apr 19 08:23:53 user devstack@n-api.service[61209]: X-Project-Domain-Id: default Apr 19 08:23:53 user devstack@n-api.service[61209]: X-Project-Domain-Name: Default Apr 19 08:23:53 user devstack@n-api.service[61209]: X-Project-Id: 13ff61fa1ead49a2b7003cbb642203ed Apr 19 08:23:53 user devstack@n-api.service[61209]: X-Project-Name: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:23:53 user devstack@n-api.service[61209]: X-Role: reader,member Apr 19 08:23:53 user devstack@n-api.service[61209]: X-Roles: reader,member Apr 19 08:23:53 user devstack@n-api.service[61209]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13ff61fa1ead49a2b7003cbb642203ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13ff61fa1ead49a2b7003cbb642203ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13ff61fa1ead49a2b7003cbb642203ed"}]}] Apr 19 08:23:53 user devstack@n-api.service[61209]: X-Tenant: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:23:53 user devstack@n-api.service[61209]: X-Tenant-Id: 13ff61fa1ead49a2b7003cbb642203ed Apr 19 08:23:53 user devstack@n-api.service[61209]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:23:53 user devstack@n-api.service[61209]: X-User: tempest-AttachVolumeNegativeTest-172980430-project-member Apr 19 08:23:53 user devstack@n-api.service[61209]: X-User-Domain-Id: default Apr 19 08:23:53 user devstack@n-api.service[61209]: X-User-Domain-Name: Default Apr 19 08:23:53 user devstack@n-api.service[61209]: X-User-Id: b0515d38f20b49b3abdbc940ca7ef30b Apr 19 08:23:53 user devstack@n-api.service[61209]: X-User-Name: tempest-AttachVolumeNegativeTest-172980430-project-member Apr 19 08:23:53 user devstack@n-api.service[61209]: method: > Apr 19 08:23:53 user devstack@n-api.service[61209]: exception: Instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 could not be found. Apr 19 08:23:53 user devstack@n-api.service[61209]: action_args: {'id': '78f0ddf0-4199-4bc6-89c5-20a20083f442'} Apr 19 08:23:53 user devstack@n-api.service[61209]: {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 could not be found. Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 could not be found. Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 could not be found. Apr 19 08:23:53 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:23:53 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-f7146aa5-fa92-4de5-8d8a-4661fb181f4b tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Returning 404 to user: Instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 could not be found. {{(pid=61209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:23:53 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-f7146aa5-fa92-4de5-8d8a-4661fb181f4b tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/78f0ddf0-4199-4bc6-89c5-20a20083f442" status: 404 len: 111 microversion: 2.1 time: 0.039052 Apr 19 08:23:53 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 151/459] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:23:53 2023] DELETE /compute/v2.1/servers/78f0ddf0-4199-4bc6-89c5-20a20083f442 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:23:53 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-06ab4782-b705-48f9-9c24-39744b579282 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:23:53 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-06ab4782-b705-48f9-9c24-39744b579282 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: 78f0ddf0-4199-4bc6-89c5-20a20083f442] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:23:53 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-06ab4782-b705-48f9-9c24-39744b579282 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:53 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-06ab4782-b705-48f9-9c24-39744b579282 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:53 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-06ab4782-b705-48f9-9c24-39744b579282 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:53 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-06ab4782-b705-48f9-9c24-39744b579282 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:53 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-06ab4782-b705-48f9-9c24-39744b579282 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:53 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-06ab4782-b705-48f9-9c24-39744b579282 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:53 user devstack@n-api.service[61208]: INFO nova.api.openstack.wsgi [None req-06ab4782-b705-48f9-9c24-39744b579282 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] HTTP exception thrown: Instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 could not be found. Apr 19 08:23:53 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-06ab4782-b705-48f9-9c24-39744b579282 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Request method failure captured: Apr 19 08:23:53 user devstack@n-api.service[61208]: request: GET /compute/v2.1/servers/78f0ddf0-4199-4bc6-89c5-20a20083f442 HTTP/1.1 Apr 19 08:23:53 user devstack@n-api.service[61208]: Accept: application/json Apr 19 08:23:53 user devstack@n-api.service[61208]: Accept-Encoding: identity Apr 19 08:23:53 user devstack@n-api.service[61208]: Connection: close Apr 19 08:23:53 user devstack@n-api.service[61208]: Content-Length: 0 Apr 19 08:23:53 user devstack@n-api.service[61208]: Content-Type: application/json Apr 19 08:23:53 user devstack@n-api.service[61208]: Host: 10.0.0.210 Apr 19 08:23:53 user devstack@n-api.service[61208]: Openstack-System-Scope: None Apr 19 08:23:53 user devstack@n-api.service[61208]: User-Agent: python-urllib3/1.26.15 Apr 19 08:23:53 user devstack@n-api.service[61208]: X-Auth-Token: gAAAAABkP6Ml6AVFrdZmwG6v9Ak3nCCxOWNoGRyfAY9VXfGPn2QRTKj8vAEzIe-ofIP9WqCqx0spEaxwaexIys1H26tCx3kz4GWtv8Xu-fJN6P665TCoRMxFVlmLehXlVDrwWQkUD447jYgz_ODpB5iqaKc80Q8eZ0hryuWlvyy82V75C3ahBos Apr 19 08:23:53 user devstack@n-api.service[61208]: X-Domain-Id: None Apr 19 08:23:53 user devstack@n-api.service[61208]: X-Domain-Name: None Apr 19 08:23:53 user devstack@n-api.service[61208]: X-Identity-Status: Confirmed Apr 19 08:23:53 user devstack@n-api.service[61208]: X-Is-Admin-Project: True Apr 19 08:23:53 user devstack@n-api.service[61208]: X-Project-Domain-Id: default Apr 19 08:23:53 user devstack@n-api.service[61208]: X-Project-Domain-Name: Default Apr 19 08:23:53 user devstack@n-api.service[61208]: X-Project-Id: 13ff61fa1ead49a2b7003cbb642203ed Apr 19 08:23:53 user devstack@n-api.service[61208]: X-Project-Name: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:23:53 user devstack@n-api.service[61208]: X-Role: reader,member Apr 19 08:23:53 user devstack@n-api.service[61208]: X-Roles: reader,member Apr 19 08:23:53 user devstack@n-api.service[61208]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13ff61fa1ead49a2b7003cbb642203ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13ff61fa1ead49a2b7003cbb642203ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13ff61fa1ead49a2b7003cbb642203ed"}]}] Apr 19 08:23:53 user devstack@n-api.service[61208]: X-Tenant: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:23:53 user devstack@n-api.service[61208]: X-Tenant-Id: 13ff61fa1ead49a2b7003cbb642203ed Apr 19 08:23:53 user devstack@n-api.service[61208]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:23:53 user devstack@n-api.service[61208]: X-User: tempest-AttachVolumeNegativeTest-172980430-project-member Apr 19 08:23:53 user devstack@n-api.service[61208]: X-User-Domain-Id: default Apr 19 08:23:53 user devstack@n-api.service[61208]: X-User-Domain-Name: Default Apr 19 08:23:53 user devstack@n-api.service[61208]: X-User-Id: b0515d38f20b49b3abdbc940ca7ef30b Apr 19 08:23:53 user devstack@n-api.service[61208]: X-User-Name: tempest-AttachVolumeNegativeTest-172980430-project-member Apr 19 08:23:53 user devstack@n-api.service[61208]: method: > Apr 19 08:23:53 user devstack@n-api.service[61208]: exception: Instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 could not be found. Apr 19 08:23:53 user devstack@n-api.service[61208]: action_args: {'id': '78f0ddf0-4199-4bc6-89c5-20a20083f442'} Apr 19 08:23:53 user devstack@n-api.service[61208]: {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 could not be found. Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 could not be found. Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 could not be found. Apr 19 08:23:53 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:23:53 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-06ab4782-b705-48f9-9c24-39744b579282 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Returning 404 to user: Instance 78f0ddf0-4199-4bc6-89c5-20a20083f442 could not be found. {{(pid=61208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:23:53 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-06ab4782-b705-48f9-9c24-39744b579282 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78f0ddf0-4199-4bc6-89c5-20a20083f442" status: 404 len: 111 microversion: 2.1 time: 0.037217 Apr 19 08:23:53 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 154/460] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:23:53 2023] GET /compute/v2.1/servers/78f0ddf0-4199-4bc6-89c5-20a20083f442 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:23:53 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-e83d6461-c6a5-4f55-b916-c2af80c30c42 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:23:53 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-e83d6461-c6a5-4f55-b916-c2af80c30c42 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: edce7876-d1a3-417f-8384-dd03e3c412cf] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:23:53 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e83d6461-c6a5-4f55-b916-c2af80c30c42 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:53 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e83d6461-c6a5-4f55-b916-c2af80c30c42 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:53 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e83d6461-c6a5-4f55-b916-c2af80c30c42 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:53 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e83d6461-c6a5-4f55-b916-c2af80c30c42 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:53 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e83d6461-c6a5-4f55-b916-c2af80c30c42 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:53 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e83d6461-c6a5-4f55-b916-c2af80c30c42 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:53 user devstack@n-api.service[61210]: INFO nova.api.openstack.wsgi [None req-e83d6461-c6a5-4f55-b916-c2af80c30c42 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] HTTP exception thrown: Instance edce7876-d1a3-417f-8384-dd03e3c412cf could not be found. Apr 19 08:23:53 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-e83d6461-c6a5-4f55-b916-c2af80c30c42 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Request method failure captured: Apr 19 08:23:53 user devstack@n-api.service[61210]: request: DELETE /compute/v2.1/servers/edce7876-d1a3-417f-8384-dd03e3c412cf HTTP/1.1 Apr 19 08:23:53 user devstack@n-api.service[61210]: Accept: application/json Apr 19 08:23:53 user devstack@n-api.service[61210]: Accept-Encoding: identity Apr 19 08:23:53 user devstack@n-api.service[61210]: Connection: close Apr 19 08:23:53 user devstack@n-api.service[61210]: Content-Length: 0 Apr 19 08:23:53 user devstack@n-api.service[61210]: Content-Type: application/json Apr 19 08:23:53 user devstack@n-api.service[61210]: Host: 10.0.0.210 Apr 19 08:23:53 user devstack@n-api.service[61210]: Openstack-System-Scope: None Apr 19 08:23:53 user devstack@n-api.service[61210]: User-Agent: python-urllib3/1.26.15 Apr 19 08:23:53 user devstack@n-api.service[61210]: X-Auth-Token: gAAAAABkP6Ml6AVFrdZmwG6v9Ak3nCCxOWNoGRyfAY9VXfGPn2QRTKj8vAEzIe-ofIP9WqCqx0spEaxwaexIys1H26tCx3kz4GWtv8Xu-fJN6P665TCoRMxFVlmLehXlVDrwWQkUD447jYgz_ODpB5iqaKc80Q8eZ0hryuWlvyy82V75C3ahBos Apr 19 08:23:53 user devstack@n-api.service[61210]: X-Domain-Id: None Apr 19 08:23:53 user devstack@n-api.service[61210]: X-Domain-Name: None Apr 19 08:23:53 user devstack@n-api.service[61210]: X-Identity-Status: Confirmed Apr 19 08:23:53 user devstack@n-api.service[61210]: X-Is-Admin-Project: True Apr 19 08:23:53 user devstack@n-api.service[61210]: X-Project-Domain-Id: default Apr 19 08:23:53 user devstack@n-api.service[61210]: X-Project-Domain-Name: Default Apr 19 08:23:53 user devstack@n-api.service[61210]: X-Project-Id: 13ff61fa1ead49a2b7003cbb642203ed Apr 19 08:23:53 user devstack@n-api.service[61210]: X-Project-Name: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:23:53 user devstack@n-api.service[61210]: X-Role: reader,member Apr 19 08:23:53 user devstack@n-api.service[61210]: X-Roles: reader,member Apr 19 08:23:53 user devstack@n-api.service[61210]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13ff61fa1ead49a2b7003cbb642203ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13ff61fa1ead49a2b7003cbb642203ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13ff61fa1ead49a2b7003cbb642203ed"}]}] Apr 19 08:23:53 user devstack@n-api.service[61210]: X-Tenant: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:23:53 user devstack@n-api.service[61210]: X-Tenant-Id: 13ff61fa1ead49a2b7003cbb642203ed Apr 19 08:23:53 user devstack@n-api.service[61210]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:23:53 user devstack@n-api.service[61210]: X-User: tempest-AttachVolumeNegativeTest-172980430-project-member Apr 19 08:23:53 user devstack@n-api.service[61210]: X-User-Domain-Id: default Apr 19 08:23:53 user devstack@n-api.service[61210]: X-User-Domain-Name: Default Apr 19 08:23:53 user devstack@n-api.service[61210]: X-User-Id: b0515d38f20b49b3abdbc940ca7ef30b Apr 19 08:23:53 user devstack@n-api.service[61210]: X-User-Name: tempest-AttachVolumeNegativeTest-172980430-project-member Apr 19 08:23:53 user devstack@n-api.service[61210]: method: > Apr 19 08:23:53 user devstack@n-api.service[61210]: exception: Instance edce7876-d1a3-417f-8384-dd03e3c412cf could not be found. Apr 19 08:23:53 user devstack@n-api.service[61210]: action_args: {'id': 'edce7876-d1a3-417f-8384-dd03e3c412cf'} Apr 19 08:23:53 user devstack@n-api.service[61210]: {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edce7876-d1a3-417f-8384-dd03e3c412cf could not be found. Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edce7876-d1a3-417f-8384-dd03e3c412cf could not be found. Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edce7876-d1a3-417f-8384-dd03e3c412cf could not be found. Apr 19 08:23:53 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:23:53 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-e83d6461-c6a5-4f55-b916-c2af80c30c42 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Returning 404 to user: Instance edce7876-d1a3-417f-8384-dd03e3c412cf could not be found. {{(pid=61210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:23:53 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-e83d6461-c6a5-4f55-b916-c2af80c30c42 tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/edce7876-d1a3-417f-8384-dd03e3c412cf" status: 404 len: 111 microversion: 2.1 time: 0.031887 Apr 19 08:23:53 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 156/461] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:23:53 2023] DELETE /compute/v2.1/servers/edce7876-d1a3-417f-8384-dd03e3c412cf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:23:53 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-0ed29f37-cc68-49b3-b920-fe6e6beaaa9d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:23:53 user devstack@n-api.service[61209]: DEBUG nova.compute.api [None req-0ed29f37-cc68-49b3-b920-fe6e6beaaa9d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: edce7876-d1a3-417f-8384-dd03e3c412cf] Fetching instance by UUID {{(pid=61209) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:23:53 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-0ed29f37-cc68-49b3-b920-fe6e6beaaa9d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:53 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-0ed29f37-cc68-49b3-b920-fe6e6beaaa9d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:53 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-0ed29f37-cc68-49b3-b920-fe6e6beaaa9d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:53 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-0ed29f37-cc68-49b3-b920-fe6e6beaaa9d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:53 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-0ed29f37-cc68-49b3-b920-fe6e6beaaa9d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:53 user devstack@n-api.service[61209]: DEBUG oslo_concurrency.lockutils [None req-0ed29f37-cc68-49b3-b920-fe6e6beaaa9d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61209) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:54 user devstack@n-api.service[61209]: INFO nova.api.openstack.wsgi [None req-0ed29f37-cc68-49b3-b920-fe6e6beaaa9d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] HTTP exception thrown: Instance edce7876-d1a3-417f-8384-dd03e3c412cf could not be found. Apr 19 08:23:54 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-0ed29f37-cc68-49b3-b920-fe6e6beaaa9d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Request method failure captured: Apr 19 08:23:54 user devstack@n-api.service[61209]: request: GET /compute/v2.1/servers/edce7876-d1a3-417f-8384-dd03e3c412cf HTTP/1.1 Apr 19 08:23:54 user devstack@n-api.service[61209]: Accept: application/json Apr 19 08:23:54 user devstack@n-api.service[61209]: Accept-Encoding: identity Apr 19 08:23:54 user devstack@n-api.service[61209]: Connection: close Apr 19 08:23:54 user devstack@n-api.service[61209]: Content-Length: 0 Apr 19 08:23:54 user devstack@n-api.service[61209]: Content-Type: application/json Apr 19 08:23:54 user devstack@n-api.service[61209]: Host: 10.0.0.210 Apr 19 08:23:54 user devstack@n-api.service[61209]: Openstack-System-Scope: None Apr 19 08:23:54 user devstack@n-api.service[61209]: User-Agent: python-urllib3/1.26.15 Apr 19 08:23:54 user devstack@n-api.service[61209]: X-Auth-Token: gAAAAABkP6Ml6AVFrdZmwG6v9Ak3nCCxOWNoGRyfAY9VXfGPn2QRTKj8vAEzIe-ofIP9WqCqx0spEaxwaexIys1H26tCx3kz4GWtv8Xu-fJN6P665TCoRMxFVlmLehXlVDrwWQkUD447jYgz_ODpB5iqaKc80Q8eZ0hryuWlvyy82V75C3ahBos Apr 19 08:23:54 user devstack@n-api.service[61209]: X-Domain-Id: None Apr 19 08:23:54 user devstack@n-api.service[61209]: X-Domain-Name: None Apr 19 08:23:54 user devstack@n-api.service[61209]: X-Identity-Status: Confirmed Apr 19 08:23:54 user devstack@n-api.service[61209]: X-Is-Admin-Project: True Apr 19 08:23:54 user devstack@n-api.service[61209]: X-Project-Domain-Id: default Apr 19 08:23:54 user devstack@n-api.service[61209]: X-Project-Domain-Name: Default Apr 19 08:23:54 user devstack@n-api.service[61209]: X-Project-Id: 13ff61fa1ead49a2b7003cbb642203ed Apr 19 08:23:54 user devstack@n-api.service[61209]: X-Project-Name: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:23:54 user devstack@n-api.service[61209]: X-Role: reader,member Apr 19 08:23:54 user devstack@n-api.service[61209]: X-Roles: reader,member Apr 19 08:23:54 user devstack@n-api.service[61209]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13ff61fa1ead49a2b7003cbb642203ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13ff61fa1ead49a2b7003cbb642203ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13ff61fa1ead49a2b7003cbb642203ed"}]}] Apr 19 08:23:54 user devstack@n-api.service[61209]: X-Tenant: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:23:54 user devstack@n-api.service[61209]: X-Tenant-Id: 13ff61fa1ead49a2b7003cbb642203ed Apr 19 08:23:54 user devstack@n-api.service[61209]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:23:54 user devstack@n-api.service[61209]: X-User: tempest-AttachVolumeNegativeTest-172980430-project-member Apr 19 08:23:54 user devstack@n-api.service[61209]: X-User-Domain-Id: default Apr 19 08:23:54 user devstack@n-api.service[61209]: X-User-Domain-Name: Default Apr 19 08:23:54 user devstack@n-api.service[61209]: X-User-Id: b0515d38f20b49b3abdbc940ca7ef30b Apr 19 08:23:54 user devstack@n-api.service[61209]: X-User-Name: tempest-AttachVolumeNegativeTest-172980430-project-member Apr 19 08:23:54 user devstack@n-api.service[61209]: method: > Apr 19 08:23:54 user devstack@n-api.service[61209]: exception: Instance edce7876-d1a3-417f-8384-dd03e3c412cf could not be found. Apr 19 08:23:54 user devstack@n-api.service[61209]: action_args: {'id': 'edce7876-d1a3-417f-8384-dd03e3c412cf'} Apr 19 08:23:54 user devstack@n-api.service[61209]: {{(pid=61209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edce7876-d1a3-417f-8384-dd03e3c412cf could not be found. Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edce7876-d1a3-417f-8384-dd03e3c412cf could not be found. Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edce7876-d1a3-417f-8384-dd03e3c412cf could not be found. Apr 19 08:23:54 user devstack@n-api.service[61209]: ERROR nova.api.openstack.wsgi Apr 19 08:23:54 user devstack@n-api.service[61209]: DEBUG nova.api.openstack.wsgi [None req-0ed29f37-cc68-49b3-b920-fe6e6beaaa9d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Returning 404 to user: Instance edce7876-d1a3-417f-8384-dd03e3c412cf could not be found. {{(pid=61209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:23:54 user devstack@n-api.service[61209]: INFO nova.api.openstack.requestlog [None req-0ed29f37-cc68-49b3-b920-fe6e6beaaa9d tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edce7876-d1a3-417f-8384-dd03e3c412cf" status: 404 len: 111 microversion: 2.1 time: 0.028906 Apr 19 08:23:54 user devstack@n-api.service[61209]: [pid: 61209|app: 0|req: 152/462] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:23:53 2023] GET /compute/v2.1/servers/edce7876-d1a3-417f-8384-dd03e3c412cf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:23:54 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-c6e187f7-ebcf-432e-b76f-50484250122f tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:23:54 user devstack@n-api.service[61208]: DEBUG nova.compute.api [None req-c6e187f7-ebcf-432e-b76f-50484250122f tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8] Fetching instance by UUID {{(pid=61208) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:23:54 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-c6e187f7-ebcf-432e-b76f-50484250122f tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:54 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-c6e187f7-ebcf-432e-b76f-50484250122f tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:54 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-c6e187f7-ebcf-432e-b76f-50484250122f tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:54 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-c6e187f7-ebcf-432e-b76f-50484250122f tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:54 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-c6e187f7-ebcf-432e-b76f-50484250122f tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:54 user devstack@n-api.service[61208]: DEBUG oslo_concurrency.lockutils [None req-c6e187f7-ebcf-432e-b76f-50484250122f tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61208) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:54 user devstack@n-api.service[61208]: INFO nova.api.openstack.wsgi [None req-c6e187f7-ebcf-432e-b76f-50484250122f tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] HTTP exception thrown: Instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 could not be found. Apr 19 08:23:54 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-c6e187f7-ebcf-432e-b76f-50484250122f tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Request method failure captured: Apr 19 08:23:54 user devstack@n-api.service[61208]: request: DELETE /compute/v2.1/servers/0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 HTTP/1.1 Apr 19 08:23:54 user devstack@n-api.service[61208]: Accept: application/json Apr 19 08:23:54 user devstack@n-api.service[61208]: Accept-Encoding: identity Apr 19 08:23:54 user devstack@n-api.service[61208]: Connection: close Apr 19 08:23:54 user devstack@n-api.service[61208]: Content-Length: 0 Apr 19 08:23:54 user devstack@n-api.service[61208]: Content-Type: application/json Apr 19 08:23:54 user devstack@n-api.service[61208]: Host: 10.0.0.210 Apr 19 08:23:54 user devstack@n-api.service[61208]: Openstack-System-Scope: None Apr 19 08:23:54 user devstack@n-api.service[61208]: User-Agent: python-urllib3/1.26.15 Apr 19 08:23:54 user devstack@n-api.service[61208]: X-Auth-Token: gAAAAABkP6Ml6AVFrdZmwG6v9Ak3nCCxOWNoGRyfAY9VXfGPn2QRTKj8vAEzIe-ofIP9WqCqx0spEaxwaexIys1H26tCx3kz4GWtv8Xu-fJN6P665TCoRMxFVlmLehXlVDrwWQkUD447jYgz_ODpB5iqaKc80Q8eZ0hryuWlvyy82V75C3ahBos Apr 19 08:23:54 user devstack@n-api.service[61208]: X-Domain-Id: None Apr 19 08:23:54 user devstack@n-api.service[61208]: X-Domain-Name: None Apr 19 08:23:54 user devstack@n-api.service[61208]: X-Identity-Status: Confirmed Apr 19 08:23:54 user devstack@n-api.service[61208]: X-Is-Admin-Project: True Apr 19 08:23:54 user devstack@n-api.service[61208]: X-Project-Domain-Id: default Apr 19 08:23:54 user devstack@n-api.service[61208]: X-Project-Domain-Name: Default Apr 19 08:23:54 user devstack@n-api.service[61208]: X-Project-Id: 13ff61fa1ead49a2b7003cbb642203ed Apr 19 08:23:54 user devstack@n-api.service[61208]: X-Project-Name: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:23:54 user devstack@n-api.service[61208]: X-Role: reader,member Apr 19 08:23:54 user devstack@n-api.service[61208]: X-Roles: reader,member Apr 19 08:23:54 user devstack@n-api.service[61208]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13ff61fa1ead49a2b7003cbb642203ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13ff61fa1ead49a2b7003cbb642203ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13ff61fa1ead49a2b7003cbb642203ed"}]}] Apr 19 08:23:54 user devstack@n-api.service[61208]: X-Tenant: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:23:54 user devstack@n-api.service[61208]: X-Tenant-Id: 13ff61fa1ead49a2b7003cbb642203ed Apr 19 08:23:54 user devstack@n-api.service[61208]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:23:54 user devstack@n-api.service[61208]: X-User: tempest-AttachVolumeNegativeTest-172980430-project-member Apr 19 08:23:54 user devstack@n-api.service[61208]: X-User-Domain-Id: default Apr 19 08:23:54 user devstack@n-api.service[61208]: X-User-Domain-Name: Default Apr 19 08:23:54 user devstack@n-api.service[61208]: X-User-Id: b0515d38f20b49b3abdbc940ca7ef30b Apr 19 08:23:54 user devstack@n-api.service[61208]: X-User-Name: tempest-AttachVolumeNegativeTest-172980430-project-member Apr 19 08:23:54 user devstack@n-api.service[61208]: method: > Apr 19 08:23:54 user devstack@n-api.service[61208]: exception: Instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 could not be found. Apr 19 08:23:54 user devstack@n-api.service[61208]: action_args: {'id': '0cd895f2-ebfe-4a0d-84c7-c617d89b88a8'} Apr 19 08:23:54 user devstack@n-api.service[61208]: {{(pid=61208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 could not be found. Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 could not be found. Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 could not be found. Apr 19 08:23:54 user devstack@n-api.service[61208]: ERROR nova.api.openstack.wsgi Apr 19 08:23:54 user devstack@n-api.service[61208]: DEBUG nova.api.openstack.wsgi [None req-c6e187f7-ebcf-432e-b76f-50484250122f tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Returning 404 to user: Instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 could not be found. {{(pid=61208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:23:54 user devstack@n-api.service[61208]: INFO nova.api.openstack.requestlog [None req-c6e187f7-ebcf-432e-b76f-50484250122f tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0cd895f2-ebfe-4a0d-84c7-c617d89b88a8" status: 404 len: 111 microversion: 2.1 time: 0.028836 Apr 19 08:23:54 user devstack@n-api.service[61208]: [pid: 61208|app: 0|req: 155/463] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 19 08:23:54 2023] DELETE /compute/v2.1/servers/0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 19 08:23:54 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-e34a848d-e531-449d-9d93-63ebda629c3c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Calling method '>' {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 19 08:23:54 user devstack@n-api.service[61210]: DEBUG nova.compute.api [None req-e34a848d-e531-449d-9d93-63ebda629c3c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] [instance: 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8] Fetching instance by UUID {{(pid=61210) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 19 08:23:54 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e34a848d-e531-449d-9d93-63ebda629c3c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:54 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e34a848d-e531-449d-9d93-63ebda629c3c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:54 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e34a848d-e531-449d-9d93-63ebda629c3c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:54 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e34a848d-e531-449d-9d93-63ebda629c3c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Acquiring lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 19 08:23:54 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e34a848d-e531-449d-9d93-63ebda629c3c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 19 08:23:54 user devstack@n-api.service[61210]: DEBUG oslo_concurrency.lockutils [None req-e34a848d-e531-449d-9d93-63ebda629c3c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Lock "bcfcbc81-3497-4f67-b5a3-a8ec0f0c0f10" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61210) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 19 08:23:54 user devstack@n-api.service[61210]: INFO nova.api.openstack.wsgi [None req-e34a848d-e531-449d-9d93-63ebda629c3c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] HTTP exception thrown: Instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 could not be found. Apr 19 08:23:54 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-e34a848d-e531-449d-9d93-63ebda629c3c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Request method failure captured: Apr 19 08:23:54 user devstack@n-api.service[61210]: request: GET /compute/v2.1/servers/0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 HTTP/1.1 Apr 19 08:23:54 user devstack@n-api.service[61210]: Accept: application/json Apr 19 08:23:54 user devstack@n-api.service[61210]: Accept-Encoding: identity Apr 19 08:23:54 user devstack@n-api.service[61210]: Connection: close Apr 19 08:23:54 user devstack@n-api.service[61210]: Content-Length: 0 Apr 19 08:23:54 user devstack@n-api.service[61210]: Content-Type: application/json Apr 19 08:23:54 user devstack@n-api.service[61210]: Host: 10.0.0.210 Apr 19 08:23:54 user devstack@n-api.service[61210]: Openstack-System-Scope: None Apr 19 08:23:54 user devstack@n-api.service[61210]: User-Agent: python-urllib3/1.26.15 Apr 19 08:23:54 user devstack@n-api.service[61210]: X-Auth-Token: gAAAAABkP6Ml6AVFrdZmwG6v9Ak3nCCxOWNoGRyfAY9VXfGPn2QRTKj8vAEzIe-ofIP9WqCqx0spEaxwaexIys1H26tCx3kz4GWtv8Xu-fJN6P665TCoRMxFVlmLehXlVDrwWQkUD447jYgz_ODpB5iqaKc80Q8eZ0hryuWlvyy82V75C3ahBos Apr 19 08:23:54 user devstack@n-api.service[61210]: X-Domain-Id: None Apr 19 08:23:54 user devstack@n-api.service[61210]: X-Domain-Name: None Apr 19 08:23:54 user devstack@n-api.service[61210]: X-Identity-Status: Confirmed Apr 19 08:23:54 user devstack@n-api.service[61210]: X-Is-Admin-Project: True Apr 19 08:23:54 user devstack@n-api.service[61210]: X-Project-Domain-Id: default Apr 19 08:23:54 user devstack@n-api.service[61210]: X-Project-Domain-Name: Default Apr 19 08:23:54 user devstack@n-api.service[61210]: X-Project-Id: 13ff61fa1ead49a2b7003cbb642203ed Apr 19 08:23:54 user devstack@n-api.service[61210]: X-Project-Name: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:23:54 user devstack@n-api.service[61210]: X-Role: reader,member Apr 19 08:23:54 user devstack@n-api.service[61210]: X-Roles: reader,member Apr 19 08:23:54 user devstack@n-api.service[61210]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13ff61fa1ead49a2b7003cbb642203ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/13ff61fa1ead49a2b7003cbb642203ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/13ff61fa1ead49a2b7003cbb642203ed"}]}] Apr 19 08:23:54 user devstack@n-api.service[61210]: X-Tenant: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:23:54 user devstack@n-api.service[61210]: X-Tenant-Id: 13ff61fa1ead49a2b7003cbb642203ed Apr 19 08:23:54 user devstack@n-api.service[61210]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-172980430 Apr 19 08:23:54 user devstack@n-api.service[61210]: X-User: tempest-AttachVolumeNegativeTest-172980430-project-member Apr 19 08:23:54 user devstack@n-api.service[61210]: X-User-Domain-Id: default Apr 19 08:23:54 user devstack@n-api.service[61210]: X-User-Domain-Name: Default Apr 19 08:23:54 user devstack@n-api.service[61210]: X-User-Id: b0515d38f20b49b3abdbc940ca7ef30b Apr 19 08:23:54 user devstack@n-api.service[61210]: X-User-Name: tempest-AttachVolumeNegativeTest-172980430-project-member Apr 19 08:23:54 user devstack@n-api.service[61210]: method: > Apr 19 08:23:54 user devstack@n-api.service[61210]: exception: Instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 could not be found. Apr 19 08:23:54 user devstack@n-api.service[61210]: action_args: {'id': '0cd895f2-ebfe-4a0d-84c7-c617d89b88a8'} Apr 19 08:23:54 user devstack@n-api.service[61210]: {{(pid=61210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 could not be found. Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 could not be found. Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 could not be found. Apr 19 08:23:54 user devstack@n-api.service[61210]: ERROR nova.api.openstack.wsgi Apr 19 08:23:54 user devstack@n-api.service[61210]: DEBUG nova.api.openstack.wsgi [None req-e34a848d-e531-449d-9d93-63ebda629c3c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] Returning 404 to user: Instance 0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 could not be found. {{(pid=61210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 19 08:23:54 user devstack@n-api.service[61210]: INFO nova.api.openstack.requestlog [None req-e34a848d-e531-449d-9d93-63ebda629c3c tempest-AttachVolumeNegativeTest-172980430 tempest-AttachVolumeNegativeTest-172980430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0cd895f2-ebfe-4a0d-84c7-c617d89b88a8" status: 404 len: 111 microversion: 2.1 time: 0.029058 Apr 19 08:23:54 user devstack@n-api.service[61210]: [pid: 61210|app: 0|req: 157/464] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 19 08:23:54 2023] GET /compute/v2.1/servers/0cd895f2-ebfe-4a0d-84c7-c617d89b88a8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)